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The 2006 (*arl D. Perkins Career and Technical Education Act required that all career technical 
education (CTE) program* offer secondary to postsecondary programs of study (POS). which 
integrate rigorous academe.*!, offer dual enrollment options, and lead to an industry- recognized 
degree or credential, focused on improving students* transition to college and careers, all states 
are required to offer at least ooe P(>S. Because few models of POS existed at the time of the 
legislation, and there was little guidance available for CTE administrators, this project took a 
"backward mapping” approach to examining mature. P OS-like programs Three sites (i.c., three 
colleges and their feeder high schools) across the country were selected for this mixed-methods 
study in which we analyzed the factors that led to their success in orikrr to inform policymakers 
and CTE administrators about the key components that might be needed to implement POS 
locally as well as to identify potential benefits of these programs for students. 

This primarily descriptive, exploratory study has twxi parts: (a) a qualitative description of POS 
development and operation at each of the sites, and (b) a quantitative account of students* 
progression through POS. The findings point to several foundational components of POS as well 
as promising outcomes for students. Interviews conducted with high school and college 
instructors, administrators, and counselors m 21X19 revealed the key requirements for making 
POS work, in particular: (a) a vision shared by multiple stakeholders of a seamless transition to 
college for students, (b) dedicated staffing for the purpose of creating linkages between colleges 
and local high schools and advising students, and <c) active advisory committees for each POS 
with representatives from local businesses. Perkins IV policy guidance for POS development, 
released in 2010 by the Office of Vocational and Adult Education (OVAE. 2010). after this study 
began, was compared with the findings from the three mature. POS -like sites. We determined 
that four of the ten OVAE components overlapped with the mature POS sites. 

Over a three-year jVTiixl from 2009 to 2012. including the transition out of high school into 
college or work, a sample of 213 high school juniors and seniors enrolled in POS at the three 
sites were tracked to examine their progression through their POS. Although only 30% of the 
students continued in the same POS in either college or work, participation in the POS in high 
school appeared to benefit students. I ligb school transcript analyses showed a positive 
relationship between POS credits, academic credits, and grades, and the majority of students 
reported that being in a POS made them more motivated to stay in school and better prepared to 
make choices about college and career. In longitudinal analyses controlling for high school CiPA. 
the number of POS courses taken in high school was significantly related to slaying in the same 
career cluster in college and to earning a college credential The number of dual credits earned 
while in high school was significantly negatively related to non-credit (remedial developmental) 
courses in college and positively related to college (iPA. staying in the name cluster, and earning 
a college credential. In addition, having a positive attitude toward the POS in high school was 
related to number of credits earned by the end of the first year of college. The majority of the 
65% of the ongmal sample that we were able to find in 2012 were still enrolled in postsecondary 
education I defined as two- and four-year colleges). An additional comparison of students in our 
sample (who had experienced the POS in high school) with a matched sample of students in the 
same major at the participating college in the largest site showed that POS students in our sample 
had higher college GPAs and took fewer remedial courses. 
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In the United States, the employment outlixik for students in the high school classes of 2006- 
201 1 who have not enrolled in college is bleak. A recent study by Rutgers University showed 
that hav ing a college credential is more important than ever to finding work as a young person 
(Van Horn. Zukin. S/eltner. & Stooe, 2012). Unemployment has a long term negative impact on 
the economy overall, as well as specifically on young adults, as they delay entry into career paths 
and earnings trajectories iKurtzlebcn. 2012). Although the recession is a considerable part of the 
problem, educators are also realizing that the United States could be doing a belter job to prepare 
students for college and careers, starting at a younger age. 

Reports such as Pathway* to Prosperity (Sv moods, Schwartz. Sc Ferguson. 2011) and Learning 
for Jobs (Organisation for Economic Co-operation and Development. 2010) have suggested that 
other nations provide more structured career preparation for secondary and postsecondary 
students. These reports have mobilized U.S. policymakers and educators around the issue of 
linking secondary and postsecondirv vocational training and work-hiscd learning. Career and 
technical education (CTE) is becoming recognized by mainstream thought leaders as a viable 
means for introducing students to careers and beginning to build marketable skills during high 
school (Achieve. 2012; Alliance for Excellent Education. 2012; National High School Center 
and American Youth Policy Forum. 2012). 

In particular. CTE programs of study (POS) may h: a promising approach to increasing students* 
college and career readiness because they integrate academics and career related technical skills 
in a sequence of courses leading to a postsecondary degree or credential. As defined in the 
Carl D. Perkins C areer and Technical Education Act of 2006 (hereafter referred to as Perkins IV) 
legislation, a POS: 

(a) incorporates secondary education and postsccondary elements. 

(b) includes coherent and rigorous content aligned with challenging academic standards 
and relevant career and technical content in a coordinated, non -duplicative 
progression of courses that align secondary with postsccondary education to 
adequately prepare students to succeed in postsccondary education. 

(c) includes the opportunity for secondary students to participate in dual or concurrent 
enrollment programs or other ways to acquire postsccondary education credits, and 

(d| leads to an industry-rccogni/cd credential or certificate at the poslsecoodary level, or 
an ascsoriate degree |or successful transfer to a four-year institution) (Section 
I22(cM1MA). 

The components of POS — such as curriculum integration and dual enrollment -arc not new in 
the history of CTE as a vehicle for school reform (Lewis & Kosine. 2008). Initiatives of the 
1990s such as youth apprenticeships. School -to- Work, and Tech Prep all provided a foundation 
for POS. Unlike previous efforts, however. POS in Perkins IV directly address the need to bodge 
the secondary postsccondary divide (c.f. Venezia. Kirst. Sc Antonio. 2003) and challenge the 
field of CTE to increase program rigor by explicitly linking academic and CTE courses m a 
coherent framework leading to postsccondary education and credentials. The intent of POS is to 
improve CTE students* preparation and likclihocxl of success m both college and careers by 
providing more structured and logical pathways beginning in secondary school. 
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Since the introduction of the POS requirement in the 2006 Perkins IV legislation, stale ami local 
(TE staff have made great strides in developing and implementing POS. Many have developed 
more than one. In support of POS development, many states have adopted the 16 Career Clusters 
identified by the National Association of State Directors of Career -Technical Education 
Consortium (NASDCTEc), which systemalK’ally define the progression of skill acquisition from 
the secondary to the postsecondary level in career-oriented educational pathways. However, 
although there is momentum around POS development. POS are so new* that longitudinal 
research exploring their nature and impicl on student education and career outcomes has been 
lacking. In 2007, the National Research Center for Career and Technical Education (NRCCTE) 
launched three tieki-based studies of POS in order to address this gap in the research. This study, 
one of these three NRCCTE studies, used mature POS-like sites that had many of the legislated 
elements in place prior to 2006 to inscribe the prores*. structure, and outcomes of POS-like 
programs at the local level. 

Background 

Research evidence on POS has not yet borne final results, and longitudinal research on CTE 
students' educational pathways in general (not POS-spccific) is limited. However, studies of 
career-based comprehensive high school reform (Castellano et al.. 2007), high school career 
majors (Gore. Kadish. & Ascltme. 20(B). secondary- postsecondary transition programs in CTE 
(Bragg et al.. 2002: Lekes et al.. 2007). and dual enrollment in CTE (Karp et al.. 2007) have 
shown positive outcomes (for a summary, sec Alfcld & Bhattacharya. 2011). In addition, 
research on career academies, which align the course work for an entire cohort of students around 
a particular career fisras (e.g.. science, technology, engineering, and math (STEM] or finance), 
show that such a school reform model can "improve labor market preparation and successful 
school -to* work transitions without compromising academic goals and preparation for college** 
(Kcmplc. 2014, p. in: Kemplc Sc Willxier. 2008). 

In the decade prior to Perkins IV, separate efforts were mode to implement and evaluate many of 
the components of CTE that later became part of the legislative definition of POS. Although 
many educators are interested m the first legislates! component of POS improving secondary* 
poistsccondary transitions for students only a few have focused on CTE programs specifically. 
The League of Innovations conducted the College and Career Transitions Initiative from 2001 • 
20)5 to “contribute to strengthening the role of community technical colleges throughout the 
United States in easing student transitions between secondary* and poslsccondary education as 
well as transition to employment and improving academic performance at both the secondary 
and poslsccondary levels" l League of Innovations, n.d. l. According to the CCTI website, all of 
the sites made progress in reaching these goals: however, evaluation results are not available. 
More recently, the Concurrent Courses Initiative (CCII in California has linked secondary and 
postsecondary lewis by providing dual credit opportunities in CTE areas, and early findings are 
promising for student transition and achievement (Hughes. Edwards. & Karp. 2012). 

The second POS component in the legislation is concerned with integrated course work in a 
coherent sequence of courses from secondary to postsecondary. Research on curriculum 
integration has shown that combining CTE and academic couracwork is challenging ( Johnson. 
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Charocr, Sc While, 2003), but that academic instruction in a (TE context can improve student 
achievement in math (Stone. Alfeld. & Pearson, 2008) and literacy < Park. Santamaria. Keene. & 
van der Mandclc. 2010 k In addition. a well- designed, coherent sequence of courses has been 
found to be one of the keys to successful dual enrollment programs tllotVinan. Vargas. & Santos. 
2008): such a sequence is also a hallmark of CTE POS. One study shows that the sooner a 
student choose* a program defined as taking nine credits in a single area —the more likely be or 
she is to earn a credential (Jenkins & Cho, 2012). POS help students select a career interest and 
focus their studies, which may help them complete college. The literature also shows that the 
more structured the college program is. the better. Specifically, this means ’‘relatively little room 
for individuals to unintentionally deviate from paths toward completion, and with limited 
bureaucratic obstacles for stuikmts to circumnavigate" (Scott -Cl ay ton. 2011). 

By far the largest body of research is on the third component of POS m Perkins IV, the 
opportunity to take college level courses while in high school — a way for high school students to 
begin earning college credits and gaining college experience, particularly if the course is on a 
college campus (Spcrom. 2010). Unlike AP courses, which are taught by high school teachers 
and geared toward top students, dual enrollment is available to a wider range of students and can 
be offered either at a high school or on a college campus (Allen. 2010). 1 findings on dual 
enrollment as a postsecondary* access and retention strategy have been upheld using different 
student populations and difVcTcnt methodologies (Community College Research ('enter. 2012; 
Hughes. 2012). Adelman <21X15 > found that earning credits prior to entering college reduces time 
to degree and therefore increases the likelihood of completion. More recent research confirms 
that dual enrollment studmts are more likely to enroll in college — and more likely to enroll in a 
four -year college than their non participating peers (Karp. Calcagno. Hughes. Jeong. & Bailey. 
2007: Speroni. 2011; Rodrigue/. Hughes. & Belfietd, 2012). Additionally, dual enrollment is 
related to improved college grade paint averages (GP.As). credit accrual, persistence to a second 
year of college, and likelihood of graduating from college (Allen A: Dadgar. 2012: Elmers Sc 
Mullen. 2003; Karp et at., 2007; Kotamraju. 2005; Michaclowski. 2007; Rodriguez ct al.. 2012: 
Speroni, 2011; Swanson, 2008). 

Increasingly, dual enrollment opportunities are being offered m CTE courses as opposed to 
academic courses.' Analyses of data from Florida showed that participants in CTE* foe used dual 
enrollment were more likely to enter and persist in college and earn higher grades once there 
compared to their peers (Karp et al.. 2007). The Concurrent Courses Initiative (CCI) in 
California, which uses a career* fanned strategy and dual enrollment in secondary-postsccoRdary 
partnerships to engage students ( Edwards et al.. 201 1; (iolann & Hughes. 2008). is the initiative 
most closely resembling to POS to date. The CCI focuses on low-income youth who are 
struggling academically or within populations historically underrepresented in higher education 
(Bel field. Hughes. Sc Rodrigue/. 2012). Participation in CCI has been found to be related to 
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higher high school graduation rates, higher lour year college enrollment rates I there was no 
cfTcct on other types of college enrollment), more college credits accumulated up to two years 
into college, anil greater persistence through college (Hughes* 2012). Researchers from the 
Community College Research Center (CCRC), who have been studying the model since 2007, 
concluded that the CCI study supports career* focused dual enrollment as a promising college 
transition strategy. In addition to allowing students to begin earning college credits, cumcular 
pathways helped students see the links between college and careers (Hcltickl et a!., 2012 ). 

There has been little research on the fourth legislated component of POS, which encompasses 
college credentials and employment outcomes of CTE participation. Research on Tech Prep 
programs in CTE showed better labor market outcomes for participants than non 'participants 
(Bragg et al.. 2002). and Kcmplc and XVillner (2008) found better labor market outcomes for 
career academy participants than non-participants, though only among males. There is potential 
for more research examining POS outcomes using state longitudinal data systems (SLDS) and 
taking a return on investment (ROIl approach (Kotamraju & Mcttillc. 2012). 

Although Rot specifically about CTE, the implications of this body of research suggest that POS 
in CTE areas with clear secondary postsecondary sequences and transition supports may help 
POS students succeed in college compared to students who do not participate in POS. 

The Current Study 

Research on various other strategies to improve student engagement and "college and career 
readiness'*’ form the ev idence base regarding some elements of POS. However, research is 
needed specifically on key elements ofClk POS. how practice relates to policy, and whether 
POS have the intended benefits for students. The objective of this study is to determine the 
critical component* of the structure and process of POS and prov ide preliminary evidence on 
whether and how POS affect students. 

We offer a descriptive analysis of three mature. POS- like sites using a two -pronged approach: 

( 1 1 case studies and thematic analysis of key factors of local POS. and how these map onto the 
legislation and subsequent policy guidance, and ( 2 ) longitudinal analyses of student survey and 
transcript data to understand bow students experience POS. An integration of the findings and 
the implications for the field unites the twxi approaches in the concluding discussion. 

We do not claim that this study represents a rigorous evaluation of the effects of POS; this was 
not its purpose. A rigorous experimental study of the effect of POS on students is being 
conducted by another team of researchers at the NRCCTE (see Castellano. Sundell. Overman. & 
Aliaga. 201 1 |. Rather, the current study used a hickward mapping apprixich to provide an 
overview of what POS following Perkins IV might look like in operation, along with a snapshot 
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of whit students might experience in POS The POS developed in the United States after the 
passage of Perkins IV are likely to h: more prescribed, and outcomes for students even more 
positive, than what we found at the three sites participating in this study. Prior to the passage of 
Perkins IV, these sites achieved goals similar to those intended for POS m the legislation and 
they did so without federal legislation, aid. guidance, or support. Formal guidance from the U.S. 
Department of Education's Office of Vocational and Adult Education (OVAE. 2010) regarding 
POS was not issued until early 2010. The POS- like programs at our sites, which were all initiated 
a decade earlier, may not reflect all of the elements OVAE has suggested are necessary for 
rigorous POS. However, we believe that this study may provide educators and policymakers with 
a glimpse into what POS might look like for high schools, colleges, and students as they continue 
to h: developed and implemented, and what the challenges and sia^csscs have been. Such 
insights might have implications for future policy. 

Sample and Method 

Site Selection 

In col labor at ion with other NRCCTE POS researchers, we reviewed previous policy regarding 
each of the Perkins IV POS components in addition to other relevant documents <e.g. an early 
version of the POS self-assessment for states dcselcped by the National Research (’enter for 
Career and Technical Education. 2009) and project materials I c.g.. the surveys developed for the 
National Assessment of Career and Technical Education, or NACTE). Research from the fields 
of career counseling and career identity development (Lewis Sc Kosine. 2008); CTE transition 
(Bragg et al.. 2002; C astellano. Stringfscld. Sc Stone. 2007; Lekcs ct al.. 2007); recent research 
on career pathway programs (Pierce, 2001}. career academics (Kcmplc. 2004). credit-based 
transition programs (Bailey & Karp. 2003; Karp et al.. 2007); and scboohtocareer programs 
(Furxtenbcrg & Neumark. 2005} also informed our study. Finally, we drew on the NRCCTE's 
literature review (Lewis & Kosine. 2006) on the history of CTE programming within the context 
of transition to postsecondary* education and the postsccondary experience. These various lenses 
contributed to our understanding of what a “mature" POS might or should look like.* 4 

Rather than search for sites that incorporated all four critical components in the legislation, 
which wxiuld have k\*n next to impossible given the short time span that had elapsed since the 
enactment of the legislation, our primary selection criteria for mature POS sites for this study 
was the first component. Specifically*, a site was considered eligible if it had a strong link 
between secondary and postsccondary levels and evidence that students had been completing 
both portions of the POS for at least two. but preferably* three, consecutive years. 

To identify a pool of mature. POS- like sites with secondary' -postseeoodary connections in (TE. 
we solicited nominations from CTE slate directors, start* from the Association for Career and 
Technical Education (ACTE), CTE researchers, and others involved in POS related CTE efforts. 
We received almost 40 nominations and conducted internet and telephone screenings to 
determine whether these sites could be considered a mature POS based on the above criteria. 
Following scouting visits to eight of the sites with most potential to collect further evidence 
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aboil! the connection bdwrai secondary and postsecoodary lc\’cb. lour sites were selected for 
irvlunon in ihe study: three agreed Ui participate A representative from the fourth site told us 
they were loo busy tu hiwt visitors and provide information for a longitudinal study. 

Sample C 7r ante ten % ti c v 

Each of the three participating mature POS sites 1 ts anchored by a community college with 
multiple area high schools feeding mto it. Desert College. located m a large city in the Southwest 
United States, is the largest of the three and has the most diverse population. The oilier two sites. 
River College and Northern College, arc both located in smaller cities in the Midwest w ith 
industrial manufacturing hoses Each college was asked to nominate two to three of their most 
mature POS for us to examine Althi>ugh Table I lists characteristics of each community in the 
study tor the pmpiwe of providing context, only those high schools offering strong POS and 
whose districts and or pnncipils approved participation were included m the study. The final 
sample therefore included six participating high schools that fed into Desert College, six regular 
high schools and one alternate high school that fed into River College, and three high schools 
that fed into Northern College Table 1 below presents information on each of the sites and the 
cities in which they are treated Follow ing the table is a brief description of each site, excerpted 
front a set of ease studies included in Appendix II. 

Table 1 

SciMed Mature POS Site . r 2009 Community' Data 


Site 

Community 

Citv Pup. Rccion 

Students 

Total Minuritv 

Area Serv ed 

Selected POS 

Desert 

College 

521,999 

Southwest 

Large. 

urban 

22,759 

53% 

9 districts (largest 
has 1 3 regular 
high schools. 9 
alternative 
sc bool i. 22 charter 
school*) 

Culinary Arts 

Consiniclian 

Tech 

Film Tech 

Northern 

College 

66,94* 

Upper 
Midwest. 
Small city 

3,909 

<6% 

2 ? districts, but 
primarily 5»6 high 
schools in 3«4 
surrounding 
districts 

Auto Tech 
Welding 

River 

College 

55,316 

Southern 
Midwest. 
Small city 

5,435 

4_5% 

1 4 high schools, 
including 2 
vocational centers, 
across 6 counties 

Mcchitronics 

Industrial 

Maintenance 


Deurt College plays a central role in postsecondary education for an urhin. largely I lispamr 
population in the Southwest that consuls of many first 'generation college students. In 2000, with 
(urge enrollments in technical areas, the college began to explore ways to build pipelines that 
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started preparing students at the high school level to enter the college. In 2001, Perkins funds 
were used to support a staff person to head this effort. By 2006, three full-time staff members 
were employed by the Office of High School Relations (OIISR). The sole function of this office 
is to work w ith area high schools on recruitment, articulation, credits, and enrollment. The 
college has articulation agreements in multiple CTE areas w ith four feeder districts, livery 
program at the college is required to have an adv isory' hoard that includes secondary, 
postsecondary, and business' industry representatives. Its CTE programs are highly attuned to the 
needs of both students and employers in the region; some students are even recruited to work 
before they have finished their programs. Due largely to the college's outreach to high schools, 
dual enrollment has more than doubled in the last few years. StatVm the OIISR nominated three 
POS as being their strongest in terms of numbers of students: culinary arts, construction 
technology, and film technology. 

Northern College is the linchpin of a regional Tech Prep consortium that includes 27 school 
districts in this unal! city. Northern is also co- located w ith the local workforce center. The 
college’s articulation dual enrollment programs started in the late 1990% and early 200Q* xn 
response to the need lor expanded CTE programs at the secondary level that high schools could 
not have afforded to implement alone. Area high school CTE teachers were retiring, threatening 
the continuation of the programs, so the schools approached the college to discus* collaborating 
and sharing resources to continue to oiler relev ant CTE programs to students. Stakeholders from 
area colleges, high schools, businesses, and workforce development were brought in to discuss 
program ideas and initiatives taking place elsewhere. In addition to Tech Prep, initial funding to 
launch new training programs to fill jobs in manufacturing came from a state scclor grant as well 
as from kcal industry. The college has a POS website showing which programs are offered at 
each high school and how each program connects with the college. The college website links to a 
state website that provides information about POS options available throughout the state. The 
Director of Academic Partnerships nominated twxi POS as their strongest in terms of the number 
of students participating: welding and auto tech. 

River College :s located in an industrial town with fairly close ties among education, business, 
and government. The college is fed by 14 high schools I including two vocational centers ) in six 
counties. Due to an arm of the college called the Odyssey program begun in 199K to serve high 
school students River College has the highest enrollment of high school students in the state, 
with 1 ,700 high school student* dually enrolled (30% of their total college enrollment). The 
college brgan developing dual enrollment editions around 2002 to provide needed skills to the 
younger generation in a town with an aging working population. Its curricula arc set in 
collaboration with the local workforce investment hoard, and agreement* between the college 
and area high schools are individually tailored by Odyssey program statTto the needs of each 
high school, including providing distance learning when necessary for rural schools. The college 
has tried to simplify the arliculation agreement prioress for each feeder high school to fulfill the 
vision that every student should be able to graduate from high school with some college credit. 
The Director of the Odyssey program nominated two popular POS for this study: mcchatronics 
(a combination of mechanical engineering and electronics) and industrial maintenance. 



Research Questions and Methodological Approaches 


We used a mixed* methods approach iC’reswcll. 21X13) to the design and data collection according 
to each of the research questions: 

1. What do mature POS sites look like? W hat are their key elements? How do they 
align w ith Perkins IV? Qualitative data were used to answer this set of questions. 

2. W hat effect do POS have on students? Do they help students' engagement, 
achievement. antTor transition to college? Quantitative data were used to answer these 
questions. 

We first discuss tic qualitative apprtxich. including the guiding theoretical frameworks lor the 
study, and then present the quantitative approach to the study's research design and data 
collection methods. 

Qualitative approach . To understand how mature POS evolved and bow they work, it was 
necessary to explore them from the ground up rather than imposing a top-down theoretical or 
policy lens. We used a combination of two qualitative research methods backward mapping 
and ease studies— that have been helpful to other researchers when analyzing complex social 
structures and relationships. These methods facilitate understanding of the components and 
mechanisms that contribute to desired policy outcomes. As Rcccsso ( 19991 noted, "the policy 
exists to create change at the knral level, but it is the Itxality which ultimately decides how the 
policy's intent will h: adapted to meet its needs" <p. 30). 

Backward mapping. Much like reverse engineering in technical fields, backward 
mapping is an approach that can help "unpick" a social program or policy implcnvmtation. The 
idea is that the analysis starts at the very end of the process— the outcome and works bickward 
to examine the inputs. This requires a nch understanding of the actors and their relationships and 
motivations, which is why most backward mapping uses case studies <!!!morc. 19X0) or profiles 
(Recesso. 1999) to understand local implementation of policies. 

Cato studies. "Case studies emphasize detailed contextual analysis of a limited number 
of events or conditions and their relationships. |Tbc ease study research method has been 
described as] an empirical inquiry that investigates a contemporary phenomenon within its real* 
life context; when the boundaries between phenomenon anal context are not clearly evident, and 
in which multiple sources of evidence are used... case study research generally answers one or 
more questions which Krgm with ‘how* or ‘why'" (Soy, 1997). 

Combination. We developed a working hypothesis (Yin. 2009 1 of POS based on poor 
relevant research, which was slightly revised in the second year of the study to reflect guidance 
released by OVAE regarding the 10 components of POS. We assumed that the purpose of POS is 
to make career pathway* more transparent for students and to support them in each step toward 
obtaining a credential. The model presented in Figure l shows the variables hypothesized to 
result in successful POS outcomes. Because the backward mapping approach starts at the very 
end of the process the outcome -and works backward to each successive level of 



implementation in order to understand now the outcome was achieved. Figure I starts at the end 
with the desired outcome of POS the smooth transition of students from secondary to 
postsecondary in a particular career area and moves backward in tune to what needed to 
happen to reach that point. The case studies I see Appendix II I allowed us to explore to what 
extent each of these elements contribute to mature POS. 



IIY POriUM/H)( OMKIBl TORS AT EACH SCCCESSIVE LEVEL 
(Kniu-d lu liuloif OVAE POS KruM« ork CMpMttli) 



I. Find 

"mature" sites 
that have 
demonstrated 
this oulcome 


2. Iklermine 
the 

postsccoodary 
elements that 
supported this 
outcome 


3. Determine what 
► supported the 
transition of 
students from 
secondary to 
postsccondary 


4. Determine 
► what guided 
students into 
and through the 
POS in high 
school 


FIGURE 1. Backward mapping successful POS outcomes 



Quantitative approach. Because students typically begin a CTE POS in their junior year and 
because we wanted to examine the entire transition penod from junior year to the second year of 
college, two cohorts of CTE students (juniors and seniors) from each of the high xcliools in the 
selected sites were studied for a period of three years. We examined then secondary and 
postsecondary' exprtience. academic and technical achievements, and initial work -related 
experiences This time frame includes the students* * last one to two years of high school and the 
first one to two years of postsecondary education and or work As a visual axi to help the reader 
understand our study design. Figure 2 depicts the paints of data collection in the life of the 
students in our sample. The youngest cohort of students was in II 11 grade and the oldest in I2*‘ 
when data collection began in Spring 2CHW. The final round of data csillcctiun took place three 
years laier in the spring and summer of 2012 after both cohorts had transitioned out of high 
school All results reported here are derived from student surveys and high school and college 
transcripts. 



FIGURE 2. Student cohorts. 


Data Collection 

All of the instruments and procedures were approved by an Institutional Review Board tlRBl 
poor to beginning data collection. In addition, schtxil districts were provided with information 
about the study and asked for their approval and cooperation ui facilitating the researchers* site 
visits and data collection efforts. Data collection began with three day site visits to the high 
schools and colleges m the selected POS sites in mid-20(W: these visits continued through mid- 
2012 . 

Qualitative. Interviews were conducted with a variety of individuals at each site, including: 


We uU.< urn) ftrrK vwlmr putt* iiifumuei.a duiut putibimuu to vuppV.-iu.-ni oillrgc launS* mu\ 

*uv.-N AiU fur lie Ml 2 tiithm -**> Sec Settaui B of lie retafe* a. *dJ u. ApfctaliA B for more *kluU 


1 1 


• Secondary pnncipil and 'or vice principal 

• Secondary counselor! n) 

• Secondary CTE instructors in Ihc PC>S of interest 

• District personnel, including those responsible for student records 

• Postsocoodary faculty in th: POS of interest 

• Postsecoodary administrators involved in the development of POS 

• Postsecoodary institutional research statVor those responsible for student records 

• Advisory committee membofs) from local businc» 

Interviews included questions about the development of the POS: 

• When did the POS begin? 

• Who started the process and what was the impetus? 

• Who was involved in the planning? 

• I low long did it lake? 

• What were the challenges and successes? 


Interview questions also asked about the structure of the POS. including: 

• course sequencing from the secoodary and postsecoodary level 

• articulation agreements 

• dual credit and dual enrollment opportunities 

• integration of academics and CTE (both within and across courses) 

• availability and structure of career guidance 

• credentials idrgrees and certifications! available to students 


Focus groups were conducted with stuifcnts to ask about their experiences in their POS. and 
materials such as course catalogs and other printed materials pertinent to the POS and or dual 
enrollment opportunities were collected during site visits. All of this information was used to 
develop the full case studies (see Appendix II). Emergent themes w ithin and acra» cases were 
coded by two researchers lor analysis and compirison with the Perkins IV legislation anal 
subsequent OVA!: policy guidance. 

Quantitative. Two types of data were collected: student surveys and school records I transcripts). 
The high school survey instrument was developed by NRCCTE POS researchers using selected 
items from national surv eys because they had already been tested lor external and construct 
validity/ The survey was piloted on an independent sample and deemed reliable for use in this 
study. The high school survey asks atxiul students* activities, attitudes about their experiences, 
and career and educational goals immediately after high school and farther into the future. On the 
detachable Irani page of the survey, students were asked to provide contact mfotmation so that 
we would be able to locate them for follow-up. 


The initial high school survey was administered on site in the spring of 2X9 to all juniors and 


' inJuilrtl tent fu«u th? Xuliufeil FJucKkctttl Lmu xuiluul Sails (NELSh idiiiiiiifcteictl b> the Xulwrul 
Center for EAa-uiun Suhsiie* (NCISt. * writ ** from High Sdxtofe Thil Weak iHSTWk * pngtn oC die 
Siuxhciu Rcgiuful Edueflflktt Baud i SRI- Hi. 

v The 44i svv WAS pilutcil b) iu tiillcugu£% ul Clcnium l/annsitY <« high >cUmiI *t their POS MtffpJc 
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seniors enrolled in POS classes at feeder high schools in each of the three sites. Also in the 
spring of 2<)09, passu e parental consent letters (with Spanish translation, where needed! were 
sent to parents describing their child's potential participation in the study and allowing them to 
opt out; only three did so. In addition, students were asked for their absent prior to taking each 



in seven POS across the three sites who were in school when we administered the survey* and 
whose parents did not return a signed refusal for their participation (the total ,V in the original 
sample was 213). 

Follow-up surveys were administered to student* annually to ask about their progress and 
changes in plans, these were administered either online or on-site; students were offered an 
incentive fa gill card) for participation in the follow up surveys. The final follow-up survey can 
be found in Appendix A. *' Multiple recruitment strategies were used during each survey round to 
maximize response rates, including emailed and mailed invitations, teacher and faculty 
announcements in class, and phone calls to participants. More detailed information on survey 
recruitment, method of administration. response rates, and incentive amount can K: found in 
Appendix B. 

The 2 1 3 students acro» the three sites who first completed a survey in 2009 are considered our 
original sample, which we followed through June 2012 using both surveys and school records. 
Table 2 shows the number of students in each POS by site. 1 About 65% of these students were 
located m 2012 . 


Table 2 

Number andPmaUa . • .* Studi i • POS Eju Umctuby 



Desert 

River 

Northern 

(ul inary Arts 

Construction Tech 

Film Tech 

Mcchatromcs 

Industrial Maintenance 

Auto Tech 

Welding 

4S <37 %) 

47 (36%) 

35 (27%) 

22 <47%) 

22 (47%) 

27 (77%) 

K (23%) 

Other 

1(1%) 

3 <6%> 

0 (0%) 

Total 

131 (100%) 

47(11X1%) 

35 (100%) 


A^r. POS citiolbtcftf life <&:leiftuwd by die uiursc He »lud:rt1 eiirolfcd in when Miivetud “OdUt** icsptifKt 
hoc thus e who ttttld ik< tc dMcimircd by class enrolled (surr*: hi|f» wUmiIs (iffcrod rrwrc ilun one uf die *:lcvk*d 

POS| of by jJudenl survey recurves Mudsills iltu note m u POS other duct those k* levied for *£udy>. 

School transcripts were collected following the end of each academic year from the high schools 
(Years 1 and 2) and the colleges (Years 2 and 3). Transcripts were masked with student ID 
numbers by the schools using, a key that was kept in a secure location. Tabic 3 below shows the 
number of high school and college transcripts available for original sample students. 

" See Alfdd ur*J BtuiiM.tur>a (201 1 ) to lb: f*si luih uhutd wmey ur«i kdV^A-uju before tie final survey. 

1 Ntrt: Itul lire POS rcflcvl indislr ul v aftiliuiu xt difTcreiil rcrum Of the sounliy (eg,. River m d Nor item uc 
lieclcd m r nenuf Ittr tnv* return* >. 
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Tabic 3 

Tranu'r/ptx Collected by Site 


Site Total Participants US Transcripts Available College Transcripts Available* 

Desert 131 107 57 

River 47 45 31 

Northern 35 35 10 

•UiiU JU-iutc* kluitrnlk Ml»n;i!l£i»it:il ll»: viillr^cutln lush kituml lu«l * tcic<4 I.« H Ii*.u! u»c |MU 

Kiijt hIukJ scrretlei (i.e . kii»A:<iN a Ik* cjmcxl dull if edit while si high xUmiI In* did t»A *ufo«Xficf«}) cwvll m 
sIk* Viill^c tire mil incluiktl. sacsllsct me viudenli mho dal ik< ullctnl lU* iftiluilfd vtdlcyri. Iniluifck klu&fZs wka> 

iithlc* iti ^ilcd After ciiiuUuu* 


See Tablet 4A and 4B for the high school and college variables* collected for our sample. All 
academic courses. CTE courses, and electives taken during high school were coded using a 
system adapted from the Classification of Secondary School Courses <CSSC). See Appendix C* 
for information on course coding. Standardized test scores, graduation status, and cumulative 
GPA were also rcconkd from the high school transcripts. 

College transcripts were collected and coded for all students in the sample who attended the 
atViliatcd college at each site (total .V -9R). 1 * In addition to transcripts, which provide 
information on courses and grades, other college records provided data on entrance test scores 
and student status (e.g.. currently active, graduated, inactive, never enrolled alter high school). 

Table 4A 


Summary TMc of High School Tran scrip: lariuhiiw 


High School Transcnpt Variables 

High School Transcript Variables 

High school attended 

Number of science credits 

Dual credits earned* 

Science GPA 

Graduated w ith IIS diploma 

Number of upper -level science courses 

Certificate earned by IIS graduation, type 

Number of academic credits 

Cumulative GPA 

Number of CTE credits 

Standardized English test** 

CTE (iPA 

Standardized math test** 

Number of English credits 

Number of courses taken within POS cluster 

English GPA 

Number of courses in a ditVcrcnt cluster 

Number of social studies credits 

Number of honors courses 

Social studies GPA 

Number of math credits 

Number of elective credits 

Math GPA 

Electives GPA 

Number of upper* level math courses 



WaVv • All diul cicdzx cimcxl by fcOidcntk in <«ii *mipV: »ctc in CTE aicax m DilTcicnl *Uiulirdi/cil *uie le*u 
••etc Itticfi ttl cuh of the thicc Site* at Etytudi ami null All wore* woe mmcitcd b> a d xtlc (pefcciitigel 

fur muW+z* 


i: lnfifititliiifi was t*A loIXxlcd fiurn «hci ttillegn* stuiknls rruy hate mended Aflci hi^h schcoJ. 
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Tabic 4B 

Summary’ Table of College Record Variables 


College Variables 

Mi*** 

Entrance exam score* 

Number of dual enrollment credits 

Number of non-credit courses 

Number of credits earned by end of first year 

Total number of college credits to date ( 20121 

C redits attempted to earned ratio 

Enrollment in degree program 

College GPA 

Courses/ grades 

Semesters enrolled 

Certificates 1 degrees earned 

Birth year 

Race and gender 

Student status 

Hole. 'These Aoa were exacted (Aim college iruntcr if<x u% well u* oilier teuton records pruviikd by lb: college* 

Slu&nt* u<jIJ cm diul erode:* while in lie hgh uIiik*] T\)S hi* then mil enroll in It* college, we do mil m.lud: 

these stu&nl* in the ixdtepe aiulytes. • Exmiii differed by *»le. DttCfl ACT ur*l Accuplatcr scores. River ACT 
and COMPASS *c\«cv Northern: Accupbccr scores. All scores were convettcil to u sxutahml *:»Ic <petccni^e> for 

iiicly sis. 


The following is a summary of the multiple types of data collected on our sample. Relevant 
items from each of these data sources and time points were transferred to a master data tile used 
for longitudinal data analysis in the third section (section C) of the quantitative results. 


Table 5 


Data Tvpc 

Number of Students 

1 ligh school original survey* 

213 

1 ligh school transcripts 

187 

Follow-up 

67* 

Final follow-up mthrmalion from other sources 

KM** 

College transcripts from atliliutcd colleges 

92 

2012 data of some kind (combination of previous three) 
i : . i «... ... ..... — : . • — ■ . . , ..... .... i 

13H*** 

TT7T7TTH: ~7~TT7T77 


2012 fnllnia-ip survey. Sons; of the tlu&f** siilialal in Ilk* number responded In rrwrc lluincrc follow mcr 
tins;. •• Thr* nuniNrr im tides tlo&nl* w!k» did u A rcspwctd lo any suncy cfln lie itutiil high school *wey. bul 
for wlern college raxed* were oNuincd arsd'or *U!u% was feuml by <*lcr uieuft* ic.g. social modu. see Apprralix 
B>. ••• Mc<e etphcu*k«< of 2012 SIJAl* ilila * presented inaction Bof the result* 


More detail about our survey data collection and data analysis methods can he found in 
Appendices B and C. which also include a description of challenges and limitations with data 
collection, coding, and analysts. 



Results 


The results of this study will be presented in two subsections due to the ditTcrcnt research 
questions and methods used for each. The discussion section will integrate both sections and 
present implications of both sets of findings for POS policy and practice. 

Research Question I (Qualitative): What do mature POS sites look like? W bat are their 
key elements? I loss do they align ssith Perkins IV? 

In earlier reports from this project (i.c., Alfeld. 2010; Alfdd Sc Bhattachorya. 2012), we 
discussed emergent themes across the three POS sites. We briefly descrih: them here, then 
compare them to the Perkins IV legislation and policy guidance around POS. < We use the term 
POS to describe the mature programs we studied; however, recall that the secondary- 
postsecondary connections cultivated at these sites had begun poor to Perkins IV.) Full case 
studies of each of the three sites are available in Appendix II. 

Emergent Theme s in Mature POS Sites 

The following themes emerged as key components of program success across the three sites: 

Shared vision of seamless student transitions. Secondary, pist secondary, and knral business 
stakeholders shared a vision of creating seamless transitions for students from high school to 
college and careers, constantly asking. “What’s best for students?" rather than "What** in it for 
us?" Leaders at each site worked to bring multiple stakeholders on board, motivated primarily by 
the goal of giving students a more cHicicnt and relevant educational experience in preparation 
for careers. 

Dedicated hi$h school relations staff at the college. Each college funded a stall’ person 
dedicated to working with area high schools to facilitate POS development at the beginning of 
the process. By the time of this study, each site had two to three dedicated staff acting as liaisons 
with area high schools. These individuals were responsible for coordinating adv isory* committee 
meetings, developing articulation agreements, arranging student schedules, advising students on 
POS course sequences, and working with high school guidance counselors to make students and 
parents aware of POS opportunities. These roponsibilitics could n<it have Iven shouldered by 
other staff at the college on top of their regular duties. 

Active employer advisory committees. The sites all had active advisory committees for each 
POS, consisting of secondary and postsecondary instructors and business representatives (some 
were alumni of the POS) who met at least once a year to discu» curriculum content, sequencing, 
and equipment according to changing industry standards and employer needs. In addition to 
these formal meetings, many instructors also had informal relationships with indiv iduals in 
industry, on whom they could call for advice, equipment, and internship placements for students. 
In turn, the businesses trusted the teachers to recommend good students for hire. 

Good relationships between secondary and postsecondary counterparts. We found that good 
working relationships between administrator and teacher counterparts at the high school and 



college facilitated POS development and maintenance. Willingness to nvike compromises and 
see other perspectives was important for maintaining goodw ill and making progress. Mach of the 
sites had encountered multiple logistical and policy challenges in creating seamless POS, but 
each had found ways to overcome these challenges to make the POS work. 

flexibility in arranging dual credit option*. Establishing dual credit dual enrollment options 
entailed finding solutions for issues like daily and semester scheduling, location of the course 
(and student transportation if necessary), teacher credent laling (if a high school teacher taught 
the course), and tuition payment (distnet funds or tuition waiver). Flexibility in policies and 
willingness to seek solutions beyond the status quo facilitated the establishment of dual credit 
agreements. 

Automatic transcription by the college of dual credit. Hach of the sites had begun enrolling high 
school students taking dual credit courses in the affiliated college, so that a college transcript 
would be generated and college credits would h: automatically tramcripted. This was a solution 
to the problem of paper certificates being lost or escrowed credits not being claimed by students. 

External grant funding to develop POS. The sites would not have had mature POS if the 
colleges had not committed resources (c.g., funding dedicated staff, renovating high school 
facilities and equipment to meet college* level standards, and offering tuition waivers) to making 
them happm. Perkins dollars w ere nK enough; all three colleges had secured external grant 
funding from a variety of sources to support the POS development effort. 

POS in Practice wnus POS in Perkin* 

In this final report, we compare the findings above with Perkins IV’ and subsequent policy 
guidance from OVAE regarding POS; these were presented in Figure 1 as a hypothesized model 
of how POS work to achieve desired policy outcomes. In the following discussion, we repeat 
some of these emergent themes, in addition to presenting other relevant information gathered at 
the sites (please refer to the full ease studies in Appendix li for more detail). 

Perkins II ’. We begin by examining the evidence of the four legislated components of POS in 
Perkins IV in the three mature POS sites: 

/. Secondary and poxttecondary education elements. The sites in this study w ere selected based 
on the fact that they already had strong secondary- postsecondary connections. Wc discovered 
through the qualitative research that what made these connections work was a shared vision for 
seamless transitions for students, good relationships among vanous stakeholders, and a dedicated 
start* person! s) at the college whose responsibility it was to create curriculum linkages, including 
formal articulation agreements, with local high schools. In addition, the colleges reported that 
their POS development efforts were supplemented with external grant funding andor flexibility 
in use of vinous funding streams. 

2. Coherent, non 'duplicative alignment of rigorous academic and technical content. Coherent, 
non duplicative (T*E course sequencing at the sites was the result of an agreement among 
advisory committee members about what studmts need to know at each successive level. 



Alignment between Cl t courses and academic courses (horizontal) wax not as evident ax the 
secondary -poxtxecoodary (vertical) alignment within the P(>S at the sites we visited. Some CTE 
teachers dcxcritvd efforts to integrate academies into their courses, which was easier than trying 
to infuse CTE concepts from multiple technical areas into an academic course. However 
although many of the POS on paper he., charts showing curriculum offerings required by the 
slate for POS approval) included academic courses as well as Cl t courses, it seemed from our 
visits to classrooms and interviews with administrators and faculty that academic instruction 
often occurred in a separate, unrelated sequence. 

3. (Opportunity for dual or concurrent enrollment. All of the sites in our study offered dual 
enrollment (sometimes called concurrent enrollment ). but the path to being able to offer it was 
described as challenging for several reasons, including working out costs, the location of courses, 
teacher crei&ntialing. and credit transcript ion. The colleges waived tuition for high school 
students as a recruitment investment, received more state funding for their increased enrollments, 
or were paid by the school districts on a per student basis. If the dual credit course was otfered at 
the college, both semester and daily schedules needed to be aligned between the institutions, and 
transportation had to be provided for students to gel to campus. If the course was otTercd at the 
high school, either the college instructor needed to travel to one or more high schools to teach the 
course, or the high lehool teacher needed to have (or obtain) the profvr credentials to teach at the 
college level. Finally, the credits high school students earned needed to be automatically 
transcripted in the college system at the time the course wax taken; students often did not claim 
the credit if paprr certificates were issued or if the credit was escrowed. 

4. Leads to an industry-recognized credential, certificate . or decree. All of the POS in our study 
led to a certificate or degree at the postsecondary level. Some also included opportunities for 
students to receive induxlry-.spxific cntry*Ievel certifications in high school and more advanced 
certifications in college as their skills progressed <c.g.. in auto tech and culinary arts). However, 
the strong training and industry ties of the programs could actually prevent students from 
obtaining a degree. For example, in areas such ax construction technology and industrial 
maintenance, desperate employers often hired students brlbre they completed their programs; 
thus, on their transcripts at least, these students appear to have dropped out when in fact they 
were gainfully employed and using highly soughbafter skills. In the film POS. what mattered for 
employment and membership in the union was hours spent working on films, rather than course 
credits or credentials: these students* transcripts often leading only through high school - also 
belie the valuable skills gained m the POS. 

OYAE Framework 

Ax mentioned in the introduction. OVAE released a ten-component framework for POS in early 
2010 that served as a guide for the CTE field in implementing the POS requirement in Perkins 
IV*. However, because the sites in this study began developing POSdike programs about 10 yearn 
earlier (around 2 (D)). we sought to understand whether the framework components are 
necessary and sufficient, or whether the findings from mature sites suggest additional or alternate 
components. Table 6 shows the ten components in OVAE’s POS Framework, alongside the key 
components that emerged at the mature POS sites in this study. The lists of components are 
organized to demonstrate where there might be overlap. 



Tabic 6 


Comparing Pe/kins IV Policy Guidance to POS in Practice 


OVAE’s 10 Components 

Key Components in Mature POS 

Partnerships 

Relationships 

Shared vision 

Course Sequences 
Legislation and Policies (and Budgets i 

C Active advisory committees 

External grant funding 


Dedicated staff 

Credit Transfer Agreements 

^ Flexibility 

Automatic CTcdit transcription 

Professional Development 


Guidance Counseling 

{Note: It is not that these six 

Teaching Learning Strategics 

remaining component* did not exist 

College. Career Ready Standards 

at the mature sites : they Just did not 

Technical Skills Assessments 

emerge as kc y components of POS 

Accountability. Evaluation 

across all three sites.) 


It is not surprising that no one-to-one correspondence exists between the components that 
emerged from implementation of POS-like programs that preceded the authorization of Perkins 
IV’ and the policy guidance that followed Perkins IV. However, despite these differences, then: is 
overlapping correspondence between Mime of the components t in the review below, OVAE 
components are bolded and italicized ; mature POS components are italicized). 

• Partnerships encompass good relationships and shared vision, discovered in the mature 
POS sites. Further, partnerships facilitate ac/he advisory committees and fosteT the 
flexibility needed for dual credit arrangements. 

• Course sequences were facilitates! by active athixory committees that provided input into 
what students shoukl be learning, when, and how. The advisory committee meetings were 
often arrangcsl by dedicated staff at the colleges who brought secondary, postsecondary, 
and industry representatives together to discu» course sequences and articulation. 

• Legislation and policies related to POS required flexibility in their creation, 
interpretation, and implementation to make the POS arrangements work according to a 
shared vision. Policies — if budgets can be included under this component- also needed 
to include line item funding for dedicated staff and allow for creative use of externa! 
grants to supplement funding streams supporting POS. 

• Credit transfer agreements at the mature POS sites needed to be negotiated with 
flexibility t in meetings coordinated by dedicated staff) and informed by stakeholders from 
the advisory committee. The goal should be automatic credit transcription so that college 
transcripts are generated as soon as a high school student cams dual credits. 

The other six components in OVAE's POS Framework were evident in some of the mature POS 
sites — as descntvd below — but they dxl not emerge as critical across all three sites. (It should he 





noted that in more recent communication* with our contacts at the sites, staftwere aware of the 
OVAE Framework and were working to iurther develop all of it* components I. It couki be 
argued tlut all of the ten components are important, or even critical* to POS; however* this study 
suggest* tliat the following six components may h: "icing on the cake” following the 
implementation of the four components descritvd above. 

Teaching and learning strategies. Many of the POS instructors wen: experts in their subject 
matter areas* highly committed to students, and well-versed in traditional C'TI: teaching and 
learning strategies such as project -based learning* prrlormance assessments* internships* and 
career technical student organizations (CISOs). We heard from students in the focus groups that 
these strategies were highly successful in engaging and teaching them about the C'TI: area. 
However, newer strategies that would better support POS. such as the alignment and integration 
of academic and technical curricula, were not as frequently observed. 

Technical skills assessments. CTE teaclers implemented skills assessments (often performance- 
based! and also facilitated student upfxirtunities to receive industry- recognized credentials while 
in high school. These credentials could be earned by taking national skills assessments or 
through otV-site. after-school employment to earn "hours" toward certification. Many of the POS 
areas ofTered a sequence of certifications that could be earned in subsequent levels of training; 
however, they were sometimes cost -prohibitive. 

Guidance counseling and advisement . High school guidance counselors were often more 
focused on testing* scheduling, and college applications than on helping students choose a POS. 
Some high school counselors were unaware of the course sequencing work that had Ixcn done 
between CTE teachers at the high school and the loral college. By contrast, the college advisors 
(including the dedicated "high school relations" stall) were much more well-versed in the POS 
course sequences, made visits to high schools to promote the programs, and talked with students 
and parents about the opportunities offered in the POS. 

Professional development. Administrators and counselors at one site received professional 
development < PI) I on how to enter POS course sequences into state templates* and teachers in 
ooc high school at another site had received PD on academic -(TK curriculum integration. High 
school teachers at two sites who taught college level classes were trained or mentored by college 
faculty. However* we did not see any comprehensive, coordinated* or sustained PI) around POS 
at any of the sites, possibly because the sites were already ahead of their states in developing 
POS -like programs and articulations. 

College and career ready standards. All of the sites were concerned with the college and career 
readiness of their students, which is why they had begun articulating CTE courses and offering 
dual enrollment. However, other than the fact that high school students in dual credit courses 
needed to pass college entrance requirements* it was unclear whether there was any particular 
standard of measurement of college readiness. As will h: seen in the quantitative results section, 
about half of the students who enrolled at the college following high school needed to take 
remedial ‘developmental courses (although that number was negatively related to the number of 
dual credits earned, suggesting that the POS can ameliorate some of the need for such non-credit 
courses in college!. Accepting the need for remediation among entenng students, the college in 
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ooc site oflered a remedial math course for free to high school seniors. In another site, the 
remedial courses wen: offered at the college at the uiik time as the CTE/POS courses so as not 
to slow momentum toward program completion. 

In terms of career readiness, two of the colleges offered employability courses in addition to the 
POS courses, and the college instructors were focused on preparing their students for work in 
industry. At the high school level, there was less visible emphasis on career readiness, though 
students in one site honed customer service skills in the auto shop, and xn another site the film 
students worked alongside adult union workers on movie sets. Although internships were 
available to high school students in some POS. they appeared to he limited due to the recession. 

Accountability ^situation. Perkins IV does not require reporting on POS student enrollment, 
therefore the colleges’ efforts to collect this information was for program improvement purposes 
only. Several college representatives were trying to track the enrollment and retention of high 
school students who had received dual credit, but this proved to be a challenging, task, 
particularly when students enrolled in other colleges and the colleges participating in our study 
no longer had access to student records. Our sites were in varying stages of progrew in creating 
statewide articulation agreements, but were clearly ahead of many of their peers in developing 
secondary -postsecoodary articulations. (>nc college was part of a statewide POS datahisc. but 
this seemed to be aimed more at helping students select and take courses in particular areas than 
for tracking enrollments and outcomes. 

Qualitative Considerations 

The site visits to the three selected mature POS sites demonstrated that there wctc key 
components to POS development that correspond with Perkins IV’ and subsequent policy 
guidance, hut that there were many areas where components were interrelated and could not be 
treated as completely separate. In addition, only four of the ten components in the OVAE 
framework could he considered key across the three sites we studied, although the other six 
components existed to various degrees, and the sites are working to improve them because they 
are now part of the Perkins IV guidance. Implications of the findings from this piece of the 
research study, as well as considerations for policy and practice, are presented in the discussion 
section. 

Research Question 2 (Quantitative): How do students experience POS? Do they help 
students* engagement, achievement, and. or transition to college? 

In addition to new data, the quantitative results presented in this report include selected findings 
from earlier reports to facilitate the readers' understanding of the pathways these POS students 
took. Detailed descriptive statistics from earlier rounds of student survey data can b: found m the 
Year 3 technical report from this study (AUeld & Bhattacharya. 2011). Additional statistical 
tables supporting findings presented in the quantitative results can b: found in Appendix D. 

The results section is organized into four sections: (a) a description of who the students m our 
sample were in high school; l b) findings regarding these students’ transition out of high school; 
and (c) a description of the effect of high school POS participation on college outcomes using 



longitudinal analyse*. A final section id) use* college system data to compare the student* in 
our simple with matched peer* on key variable*. 


findings should be interpreted as applying only to the students enrolled in the selected POS at 
the selected sites who participated in the study. It should be kept in mind that, except for the final 
section, no comparisons are bring made to students not enrolled in a POS. In addition, no 
comparisons are being made between students in different POS or ditVerent sites; for the purpose 
of this study, all student data were pooled for analysis. 


A. Selected Hit'll School I^evcl- Finding* 

High Sc hoof Descriptive* The student survey data initially collected Irom our sample when 
they were juniors and seniors <.V -213) showed that about half of the students (at were in the 
POS that most interested them, (bt said that their school offered enough courses in their POS, 
and (c) expected to complete at least four courses in their POS by graduation. Two-thirds 
reported that their POS was related to their career goals, but about a fourth clamed the POS in 
which they were most interested was not offered at their school. Table 7 shows that, for the most 
part, students had positive attitudes toward their POS. It slould be noted that the survey 
questions referred to "program of study** rather than "POS" but did not define it; some survey 
questions used "program of study or career pathway.** 


Table 7 

Students ' Attitudes ahat/l POS 


Heine in a POS... 

Strongly 

Disagree 

Disagree 

Agree 

Strongly 

Agree 

Made me more likely to come to 
school 

3% 

21% 

54% 

22% 

Made me less likely to dri^i out 

9% 

13% 

53% 

26% 

I Ielpcd me make connections 
between school and the career that 1 

want 

2% 

15% 

51% 

32% 

Made me focus my studies so I 
know where 1 am headed 

6% 

14% 

54% 

26% 

I Ielpcd me get better grades 

4% 

26% 

52% 

18% 

Made me feel like I tit in better at 
school 

9% 

27% 

52% 

13% 

Made it more likely that I would 
take courses 1 need for the future 

4% 

12% 

54% 

30% 

Made it more likely that my parents 
got involved in my selection of 

courses 

10% 

37% 

42% 

10% 


MMU. I>4U tnicte 




Students who reported that their POS was in their career area of interest had significantly more 
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positive attitudes about POS (on a scale constructed from the items in Table 7; see Appendix C), 
A / - 3.01. SD - .53. compand to students who reported that their POS did not match future 
career goals: A/ - 2.57. SD - .50; t < 169) - 4.63, p.OJ 

Confirming the qualitative observations at the participating high schools, the POS students 
reported on surveys that they were not receiving much guidance from counselors. Students were 
mostly getting advice on what courses to take from their friends and parents, and found their 
parents to be most helpful in this regard (about a fifth of students reported that "no one’* was 
helpful}. Less than 20% reported talking to a counselor three or more times about course 
planning since the start of high school, and 6R% never took part in a parent 'Counselor* student 
conference for courxc planning purposes. However, between 14% and 47% (depending on the 
topic) reported talking with a counselor about what courses to take, grades, going to college, 
applying to two»ycar colleges or technical schools, possible career paths and the steps necessary 
to pursue them, and or finding a job alter high school. As guidance and counseling is one of the 
components of the OVAE Framework, it seems that this is a likely area for improvement. 

Although all of the sites in the study offered dual credit, almost half of students reported on their 
surveys that they did not know if any of their POS courses were offered for dual credit. 

Interviews at the sites also revealed that sometimes students did not know that they were in a 
POS or what the available course and pathway options were. This suggests a gyp in the 
information available to students. As these POS continue to evolve, improvements in counseling 
and guidance could conceivably ameliorate this gap. Improvements might include requiring more 
meetings with counselors and including parents in these meetings, more fi>ms on guidance from 
informed teachers in the POS. and accessible, updated school websites. Despite receiving less 
than ideal guidance on course selection, students reported doing their own research atxiutyobs 
and college options. Depending on the topic fe.g.. activities on the job. training needed, which 
colleges offered training, salary range, hours required, and how to get the job). 30% to 45% 
reported "a good deal of knowledge" about their chosen career field. 

About one-third of students reported participation in on internship or co-operative education 
(hereafter referred to as a co op), however only 23% reported that their experiences in these 
types of work-based learning (WBL) experiences were “closely related" to their career choice* 
(33% reported that tlvrir WBL was "not related at all" to their career choice, and 44% reported 
WBL as “somewhat related" to career choice). Although not an explicit component of the OVAL 
Framework, WBL is a teaching and learning strategy that could enhance the POS experience if it 
were more related to students’ career areas of interest. Almost half of the students in this study 
were working for pay while in high school (a third of whom worked more than 20 hours per 
week): two-thirds said their job was "not at all related** to their career choice, fins seems to be a 
lost epportunitv for career training while students arc still in school (Dcil-Amen Sc Deluca. 

2010 ) . particularly when compared with the opportunities for youth in other countncs (I tollman. 

2011 ) . 

As described in the introduction to this report, prior research suggests that dual credit can 
increase students* chances of entering and completing college. As Table S shows, the number of 
students in our sample who earned any kind of dual credit ranged from very few at Desert 
College to all of the students at River College (we note that all River College students in our 



sample w ere enrolled in River’s "Odyssey” program, a college program offering dual credit to 
high school students). 


Table 8 


Sa mple Students Earning Any Dual Credit fry Site 



Number of Students Earning Dual ( redit < Percent ) 

Site 

Yes 

No 

Unknown 

Desert 

15(12%) 

102 (78%) 

14(11%) 

River 

47(10(1%) 

0 (0%) 

0 (0.0%) 

Northern 

17(49%) 

16(46%) 

2(6%) 


Table 9 shows the subset of students who earned dual credit in their POS. specifically. 


Table 9 

Sample Students Earning Dual Credit in Their POS by Site 1 * 


Site 

Number ot Students Earning Dual ( redit (Percent) 

In POS Not in POS Total Dual C redit 

Desert 

4 (27%) 

1 1 (73%) 

15 (100%) 

River 

47(100%} 

0 (0%) 

47 (100%) 

Northern 

. Iho lAltlc wu/iilr* mil 

17(96%) 

s riuilnm •• In* i.frvitu- 

0 (0%) 

rn < 

17 (100%) 


k « 


One reason for fewer dual credits earned by students at the Desert site may he tint this site w as 
further behind the others in establishing dual credit options. partly because of its large size 
{Desert serves multiple districts with hundreds of POS I and the additional layers of approvals 
needed for it to form each articulation agreement. Further, in the film POS at Desert, courses and 
credentials woe less important for employment than hours spent on movie sets that counted 
toward union memberships, which provided less incentive for students to earn dual credits 
compared with other POS or sites. 

/Iit(h Sc hoot Correlations 

In addition to the descriptive data presented above, correlational data also contribute to 
describing our sample while they were in high school. Multiple bivariate hypotheses generated 
from the literature review were tested regarding the relationship fortween POS-related activities 
and a variety of experiences and outcomes (sec Appendix D lor a full correlation table). 

Although relationships between variables on the high school survey are fairly mixlest and cannot 
be interpreted as causal because our data are cross* sectional, given our small sample size, their 
significance is worth noting. {Longitudinal relationships will be described in the section entitled 
Longitudinal Results High School to College.) 

Transcript only (N - IS?). ** Some scholars concerned with “tracking” have suggested a 
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negative relationship between CTE and academic course-taking and achievement (see Ho/ick & 
MacAllum. 2(102. and Deluca. Plank. & Estacion. 20(16. for reviews!. However. POS are 
theoretically more rigorous than traditional CTE programs, thus the following questions were 
examined: 1 ’ 

• Is there a negative relationship between earning POS credits and math or science 
credits ? NO. In examining the data from high school transcripts, we found that students 
in our sample who earned more CTE credits also earned more math (.53 4 * ) and science 
(.52* •! credits. 

• Is taking a greater number of POS courses negatively related to grades in math and 
science? NO. The number of POS credits earned by students in our sample was 
positively related to grades in both math (.14*) and science (. 22 **). 

• Is there a negative relationship between taking a greater number of POS courses and 
standardized test scores? NO. The number of POS credits earned was not significantly 
related to math standardized test scores among students in our sample, and there was a 
positive relationship between POS credits and English standardized test scores (.19*). 1 

Surteys and transcripts (X - I ST/. Combining high school survey data and transcript data using 
students* study II) numbers, we were able to examine relationships between students* self- 
reports and their school records. A greater number of POS credits was related to hav ing a 
positive attituik: toward POS (.16*) and to the belief that what is learned in school will b: useful 
later in life (.I5 4 ). 1 * Satisfaction with the help students received when choosing courses was also 
related to the number of POS courses taken (. 16 4 ). Students* (iPA in high school CTE courses 
was related to consulting with a counselor (. 24 4 *)/’ the number of POS credits earned (.16*). 
and having a positive attitude toward POS (.16*). Additionally, consulting with a counselor was 
linked with a positive attitude toward POS (.5()* 4 ). This suggests that cither counselors are 
playing a key role in “selling** POS to students and promoting student engagement through POS 
participation, or that the higher achieving, more engaged students are more likely to meet with 
their counselors. 

To ensure that it is not only the “good** students reaping the benefits of POS- related experiences, 
all of the following relationships were examined after controlling for (iPA I although we caution 
that causation still cannot be determined from these cross- sectional data): 

• Students taking more POS courses were more likely to believe that what they learned in 
school would be useful later in life ifi - .147./? < .05) and were likely to earn more 
college credits w hile in high school .664./? < .01 ). 

• Students who talked with their counselor* more often about what courses to take, grades, 
going to college, applying to two-year colleges or technical schools, possible career paths 
and the steps necessary to pursue them, and or finding a job after high school were more 
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likely to report having researched careers \fi - . 22 . p 01 ). college options \fi - 22 , p * 
. 01 ), and industries with the most job growlhuf) partiality ifl - 20 , p • 01k 

• Consulting with a counselor was related to positive attitudes toward POS - .29, p < 
.01 1. and positive attituifcs toward POS were related to students’ belief that what they 
learned in school would be useful later in life \fi - .4 1 . p < .01 1 

• Students who participated in internships or co-ops that were closely related to the job 
they wanted to have in the future were more likely to have positive attitudes about their 
POS (ft - .24. p < .01 ) and were more likely to think that the informal iimi they learned in 
school will he useful later in life (ft - 24. p < 01 ). 

These cniM-scvlional results from the high school survey suggest tint POS pirticipation has a 
positive relationship with many desirable student behavior*, attitudes, and outcomes that are 
associated with educational success, even when controlling for CiPA simply put. students at all 
achievement levels seem to benefit from POS The next section describes data on students* 
graduation from high school, enrollment in college, and (for some) finding work 

II. Transitioning; From High School to College and Work 


If they were on schrdule. all of our sample students (A T — 2 13) should have graduated high school 
by the spring of 2010." As shown in Tabic 10, over 90% of the original high school sample 
graduated from high school (the other 10% are unknown I. This compares favorably to state 
graduation rates, winch ranged from 67% to 8S%/ Although w*c cannot determine with cru»* 
sectional data whether tlic likelihood of graduating from high school is affected by POS 
participation, we do know from the surveys that student* in POS report that being in a POS 
make* them less likely to drop out (refer back to Table 7). 


Table 10 

,V>? j»i;*iV StmK-fit Httf: .SWn.xn 1 Orudnuf/off fcjfc r>. .Vr-vi/i? 2010 Sue 


Sue 

POS Sample (iraduation Rale Number ( Percent I 

Stale Graduation Rale 

Desert 

118(90%) 

67% 

River 

43 (92%) 

80% 

Northern 

31(89%) 

88*4 


In the summer of 2012. college records were obtained lor as many of our sample students as 
possible from the affiliated college at each site in order to report the most up-to-date information 
by the end of the longitudinal study. If tlic student did nut have a college record, we obtained 
college and or work status information cither from their final survey or from online searches 
(e g , Facebook) conducted in the spring of 2012. Wc were able to find current information on 
138 students (65% of our original sample)." 
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Figure 3 shows the July 2012 status of ihc 138 students fur wham we were able u\ collect 
information via surveys, college records, or internet scarvlic* in tlic spring summer of 2012 .' 
Over twiMltinli of those for whom we found infocination arc still attending college (and may 
also he workinu). whereas the remaininu one-third arc working but are no longer in school 
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Using all available information, including inhumation we had Iram earlier rounds o I data 
collection, we war able to determine the proportions of students in the sample who continued in 
their high school POS. stayed within the same career duster xi the POS (a less conservative 
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measure), nr enrolled in a different cluster entire ly/ * 1 * 


F igurc 4 A shims tliat almivst two - thirds of our sample students ( 1 39 of the 2 1 3 students, or 63" • I 
transitioned to a postsccondary institution immediately after Inch scbuol.' Although 37 students 
continued m the same POS in college, 52 stayed in the same cluster. Thus, as Figure 4B shows, 
of the students in our sample who continued on to college, a little over one- thud 1 37%| 
continued in the same cluster as their high school POS. 


E.\amininu both college and work status information (Figure 4Ck 63 students continued in the 
same POS cluster as high sclsool in either a puit.se cundary institution and or a job/ 1 It is possible 
that more students pursued their POS cluster atier high school, but we tki not have this 
information Thus, a conservative estimate is that about 30% of the original sample of students 
continued in their POS in either college or work 
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FIGURES 4A. 411 and 4C* Proportions of students going to college und staying in their high 
school POS cluster 


F.\amimnu the data in a slightly different way. Figure 5 shows students* transitions from 
secondary to postsecondiry pursuits for all 213 students in the original sample. 
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FIGURE 5. Student pathways to 2012 statu*'* 
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As Figure 5 show's, most students 1 1 03 of the 139) who enrolled in college after high school went 
to one of the three colleges participating in our study. The breakdown was as follows: Desert 61 
students <47% of the Desert simple); River 3 1 students 166% of the River jarnple); Northern: 1 1 
students <31% of the Northern >amplc).*' J In addition, the largest percentage of students 
continuing within the sime cluster as their high school POS is anting the subgroup that enrolled 
at one of the atViliated colleges, which suggests a seamless connection between the high schools 
and colleges for the POS at these sites (and or that this is the closest college or the only one with 
the desired program). As noted. because most of our students are still in college as of the time of 
the writing of this report, it is too early to tell what their ultimate educational and career 
outcomes will he. 

To illustrate possible POS pathways at the sites in this study. Figure 6 depicts the progression of 
students in our sample who transitioned Irom high school to the atliliatcd college <which 
provided transcripts) or straight to a career <as indicated on surveys) within their POS. More 
examples of courses otVercd within each POS are included in Appendix C. 

The follow ing visuals depict the progression of courses a student might take within a particular 
POS. as they transition from high sclool to college. All examples shown here arc pathways of 
actual students in the sample, derived from their high school and college transcripts, and self- 
report <survey) if the student did not attend an atViliated college. 
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FIGURE 6. POS itudcnt pathway*. 
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Final sundry results. A short final survey wax answered by students in 2012; this survey 
solicited information about their current statu* ~ and included retrospective questions about high 
school. Although 34 of 50 students agreed in a closed ended survey question that their high 
school provided adequate preparation tor college. 37 had suggestions for improvement in 
response to the i^ien ended question. “How could high school have better prepared you for 
college or work?** These suggestions fell into four larger categories, examples of w hich are 
shown in the text box below. As noted, the 50 students who answered the 2012 final survey may 
not be representative of all 213 of the students in the study. Their responses suggest some areas 
for I\)S improvement. 

Selected Student Suggestion* in Response to the 2012 Final Sunn Question: 

‘•lion Could High School Have Better Prepared You for College or War*?" 

Provide more rigor accountability: 

• JYoiXu/a twii Id Asm* Acisi mare demanding usd »•»/ me more. College teas .much Am of a 
shock as far as u o/kloadiime manages** wt 

• JIM students moj e an <AtKiab}c(or homcuo/k. < hallenging c ott/sen ark. 

• High Ai is nothing lik*' college. the homenork is so mm Xj more intense. As Much as / 
ka red Aomeno/A. is would Asm* been easier n> OaiuiiuM to a neu hfesuie if high school had 
bn ■me similar senior year 

Provide different or improved instruction method 

• Sim fund c ou/ses more, taught in mote secpunc e 

• High si boot could Aim* Aeiit more encouraging and engaging 

• Mwc am* on one lime 

Provide a clearer connection with college; 

• Four years cf mailt . math ihat nos /ek^ant to a transitio/t to college, science* that we/e 
transitional {sief to c allege. 

• Haw more college cud it crpposxu /titles. we /e far uujj from e/asesr community college. 

Provide instruction that is better aligned with carver preparation: 

• fern x mote about %'syday n orking and mathematics instead of Ion er -paced math and 
education mc//e practical skills 

• Tty to give more real-novld experiences, utmU A me teamed more uiiif Aren more prepared if 
they Mi ' ah ouv wore seal world situa turns 

• Mo/e direct cc/mmuNuaiafU prac cical skills. sealuio/ld examples 

Students |xist*high school plans, as reported on the initial high school survey administered in 
2019. were compared to students' actual status both immediately post -high school and three 

'* rune Aid of ih: <0 itufctt* < 2 J% of ih: c«tgirul simple) in iH: find sun cy, 76% arc * ill 

enrolled hi tullcge AN.nl 24% base cuuoA cither j ccitif Vde o« un AMMlie's ikgicc (Adr nuuitns ire cscnlv 
bclu ccft die twoK A milling dtfUandy til rctcdcxl llul lint*; *h» kvk it it find suney fiber >em afl« lt»; 

ti« si *u\cy) rcpc«led * higher fillici ’> lescl of edition. higher topaiUMU, ji»J u h^lin h^Ji sclincd (iPA llun 
fexmopiirftleftfx (Xtci demnpiptiit difTctciKCs were to* significant. 
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year* later (see Table 1 1 ). Interestingly, the percentages for planning to attend and actually 
attending twxi- and four-year colleges "flipped" : More students actually attended a two-year 
college than planned to. whereas fewer actually attended a four* year college than planned to 
(although most students are still in school as of this writing and some may still transfer to a four- 
year college). Possible explanations are that students may now be more realistic about credentials 
needed for the Job market, or more realistic about their own abilities. The proportions of students 
in two-year colleges and working in 2010*201 1 and 2012 reflect students' leaving college and 
moving into the workforce. 

Table 1 1 


CiMiparixon of 2009 Ssudent Awirntions and 2012 Actual Status 


Student Aspiration Actual Status 

2009 Plans* 

2010-2011 Post High 
School Activity 

2012 Status 

Technical 'trade school 

13% 

4% 

3% 

Tw<s- year college 

32% 

61% 

35% 

Four-year college 

36% 

21% 

21% 

Work 

7% 

10% 

24% 

Military 

4% 

2% 

2% 

Unemployed & not in school 

NA 

1% 

1% 

Unknown 

NA 

N/A 

15% 


Wou D./-I wMtfcet Hifh Sillied 2009 >ut . cv (fur 2lMr9 filial fbHow-up uincy. iuJIcgc icvccih. usd online 

(Kinds <&« I».l-lii>tt sihncdiKtivity Mid 20 1 2 >£u!u«|. V - 156. 'An ^AJiIaiuI ?** uvre uiisuic of iteii pUn* dki 
h»»h sillied us*l 1 % plaiifeil to iUm\ a family. 


Although the response rate to the final survey was low and the numbers are small, several other 
interesting findings emerged. Nearly half (.V “ 17) of those currently in college who responded 
to the final survey* agreed that their college major choice was influenced by a CTE class taken in 
high school; 1 1 of these 17 students chose a college major in the simc career cluster as their high 
school POS. suggesting that the POS was influential for these students in some way. 

Of the 36 survey* responders who were working at the time of the final survey <29 of whom were 
attending school at the same timcl. the majority had positive feelings about their yob. Nearly 
three -quarters of these students (26t perceived their Job as providing opportunities for 
advancement, and 29 reported that their job allowed use of existing skills and abilities. About 
two- thirds 1 241 agreed that their current Job helped with access to more education or training, 
however. 10 students reported that their current Job had actually hindered them from getting 
desired education or training. Half (IS) »aid their current yob is "not related at all" to the yob they 
would like to have live years from now. Ideally, work and school experiences would be more 
connected in order to help young people prepare tor future careers (Deil'Amcn & Deluca. 2010). 

C. Longitudinal Results: High School to C ollege 

The college-level results reported in this section are limited to the students in our sample for 
whom we have college records from the three participating colleges in our study. Before 
presenting the longitudinal prediction models using students* high school and college data, we 
first examine the milestones considered to be important for college student success, according to 





the Community College Research Center l Bailey, 201 11. Each indicator of student success is 
listed below, along with the results from our data: 

• Took and passed collcgedewl courses (for students starting it i remedial programs / Of 
the students in our sample who took at least one remedial developmental course, 74% 
were cither still enrolled in college as of 2012 or had graduated oc transferred, indicating 
persistence with postsecoodary education. 

• blamed S2 college credits and Mil! enrolled. Foe the 87 students in our sample for whom 
we were able to collect college transcript data, 55% had earned at least 12 college credits 
by the end of their first year (this figure decs not include dual credits earned prior to 
enrollment). Of the 12 ♦ credit group, 77% persisted with postsccoidary education as of 
2012 fi.e.. these students are currently enrolled or have graduated or transferred). 

• Persisted term to term and year to year. We report whether students arc still enrolled, 
graduated, withdrew, or transferred. Those in the first two categories persisted term to 
term. 

• blamed SO credits and still cn /oiled. Thus far. only four students have earned at least 30 
credits, but almost half of the sample is still enrolled; thus it is too early to determine. 

• blamed occupational certificate. 1 5% of our sample had done so. 

• blamed associate degree. S% of our sample had done so. 

• Transferred to a baccalaureate program. 1 0% of students in our sample who enrolled in 
a community college after high school had transferred to a four-year institution by 2012 . 

The students in our sample who went to college appear to have been successful thus for, 
according to the above criteria, but it is still too early to reach conclusions about their 
postsecondary outcomes because most of them are still enrolled as of the time of this writing. 
Because the ratio of credits attempted to credits earned has been found elsewhere in the literature 
as a predictor of college retention (Scidman, 201)5). we also examined this in our sample and 
found that the ratio of college credits attempted to credits earned was significantly related to high 
school GPA (.40* 4 ). high school standardised math test scores (.54“*), college entrance exam 
scores (.25*), and college CiPA (.63**). W Although these results confirm that high-achieving 
students are successful in college, none of the high school POS variables were significantly 
related to the ratio of credits attempted versus credits carnal. 

Using multiple regression techniques on a combined longitudinal dataset of survey and transcript 
data from high school and college levels, we examined the effect of high school-level variables 


Include* ttk*c wbn earned a certificate at tU* cod ut* high *cIkoI with dual until*. 

14 Whrft eroding the ratio variable. if edit* earned its listed all of the aJteftqMcd OMlttCt l)u! a Mister* pa*cd (rcdil* 
a l tended tin illicit Ail mi Util appeared ui college incssciipl* Alter the student enrolled, me telling mm-cvedii 
And wilts* a w aI* hbt etchslatg dull credit*. There ne cunllicting report* in the tiler Alurc a* in whether or t*A to 
iis lute in die “credit Attempted" ratio ll»e couimt* from which a Mudenl withdrew. Kalhenne Hi^he* of the 
<*<mmunily College Rc*c*cch Cento (CCRCl »i^geMcd I personal ttimniuncaliun. August 14. 2012 1 that “W~ 
cmiiso stsuld t*.* nsluded tocau *e if a Muter* wilhhaw* turn a c\m>e tenng the initial div^s uAl grace pci sd (d 
Ihe *Url of a semolcr. these course* would nnl Appear on (he irutKlfl CM0tt from which a Muter* withdrew ihil 
Appeared <*% (lie iludeflTt n an*r f5t me truly "cfOdit* attempted" aid are llieicfore included in our count. 

" Outcurne* neve deiciiiiiued from liigh setaol IrufMfqX* icid in college tnetsevipt*. teprrdmg <tt the data 
available fur each Muter* Record* could not he stem died fur seveial Mutenl* fur multiple reason^ metediug 
mewing. mcIamiIi having pemiiuidA to release record* fur paticular Mutent*. or mil being able in ster*dv 
Muter** by rurre* p mated un *mcv* 



thal wen; hypothesized, based iwi our literature review, to prediet a number of post-high school 
outcomes of interest. WBL and guidance counseling (sec Figure 1) were included in preliminary 
analyses as potential predictors, but were not included in the final models because of the small 
numbers and the fact that these variables did not make significant additional contributions; 
further, too few* students participited in CTSOs to consider adding this variable to the model*. 


Table 12 below shows the statistical models for each posticcondary outcome of interest using 
high school variables as predictors. Each column represents a separate regression model. Sample 
sizes diHcrcd across the models defending on the number of students for whom we were able to 
obtain oulcomc data (see the last row of the table). All of the models were significant overall (j> 
< .05). High school CiPA was entered into all of the model* to control for stuifcnt achievement 
when examining the effects of number of POS courses taken, attituikrs toward POS (a scale 
created from the high school survey, a - .85 1 . and number of dual credit courses taken (these 
were virtually all in Cl h courses in this sample, as explained earlier) on college outcomes. 

Effect sizes ranged from small to medium. Prior to finalizing these regression model*, 
correlations between other available high school variables and college outcomes were also tested 
(refer to Tables 4 A and 411 for variables available). See Appendix I) for the full table of 
correlations of all of the variables included in the regression models. Our sample size was not 
large enough to test structural models or mediating variables. 

Table 12 

Effects of High School POS- Related Bchaviort and Autiwta on Posh High School Outcomes 

Number tit 
cr exits 

Number of earned hv 



Entrance 

CAUtil seicc 

remedial 

course* 

the cud of 

Yen 1 

Ciillege 

CiPA 

Sliiwd III 

lamed 

credential 

Attended 

four -veil 

C*oenicl(M 

<SE> 

Coeltkicni 

(SE> 

( tXtliCIClU 

t.V£l 

Coefrxicm 

( SE) 

Coctfkieiii 

4SO 

Coeitkl 

(SE) 

eni 

ItUCfvCfC 

0.26 

0.9S 

-KJS 

0.17 

0.73 

-0.02 

4)27 


(0.09) 

(1.55) 

(6.63) 

(0.67) 

4029) 

(0.251 

40.20) 

IIS CPA 

0.09* • 

-0.17 

5.22** 

0.52** 

-0OI 

0.06 

0.3f* 


(0.05) 

(0.571 

41 M4) 

(U.IK) 

4007) 

(0.061 

40.05) 

Number 

0.00 

0.01 

-007 

U.U3 

037** 

0.04* 

4)02 

ot POS 

(0.01) 

(0.(01 

40.30) 

(O.W) 

4002) 

(0.021 

40.01) 

course* 









POS 

0.01 

0.45 

5.14' 

0.20 

0.15' 

-0.U2 

-0.10 

1 

Attitude 

(0.05) 

(0.54» 

4169) 

(0.17) 

400M) 

(0.07) 

40.05) 

Number 

-0.01 

-0.22** 

-004 

U.U9* 

0.03* 

0.02' 

0.01 


of dual 

AAA f l A A 

(0.01) 

(0.07| 

40.31) 

(0.05) 

4001) 

(0.01) 

(0.01) 

vllU.t 

<HS| 









E 

4.54* 

3.16* 

3.24* 

4.H4* 

5S6* 

2.KK* 

12. M3 


if' 

0.21 

0.14 

0.14 

0.17 

0.15 

OOK 

0.27 


Effect iix 

0.27 

0.16 

0.16 

0.20 

0 IM 

0.09 

0.37 


N 

74 

K2 

M2 

9M 

135 

145 

142 


M 

55% 

14 

14.5 

2.47 

NA 

PA'A 

NA 


NOUS. IlllCCCgt value wl 

a;ii all picdu'K 


- p < 03. •• p< 

■01. ,,T p : 

7S7T r ■ to 

lircrJT 
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• As they reflect student achievement, college entrance exam scores were, not surprisingly, 
most strongly predicted by high school GPA; other high school variables were not 
significant predictors of college entrance exam scores. 

• The number of remedial developmental courses required in college was negatively 
predicted by the number of dual credits students earned in high school. Because high 
school GPA is also in the model, this result suggests that dual credits are helpful, 
regardless of achievement level, in helping students bypass remedial courses and move 
into credit-bearing courses in college. 

• The number of credits students earned in college by the end of their Pint year was 
predicted by high school GPA; attituifcs toward POS m high school also tended toward 
significance, suggesting that positive POS experiences have a beneficial cfTcct on 
students in college above and beyond CiPA. POS courses taken, and dual credits earned. 

• College CiPA was. not surprisingly, most strongly predicted by high school CiPA. 

Number of dual credits earned was also a significant prediclor of college CiPA. again 
indicating an additional boost to students' college success otVered by taking college* level 
courses while in high school. 

• Staying in the same career cluster as one's high school POS was related to the number of 
POS courses taken in high school; clearly, these are the students most interested m the 
POS. v * Indeed, positive attitude toward one's POS in high school also tended to predict 
staying in the same cluster in college. Finally, staying in the same cluster was also 
predicted by number of dual credits earned by students in high school, which were 
primarily in POS. ' 

• famine a credential (certificate oc degree) in college at least by 2012 — was predicted 
by the number of POS courses students took in high school, and also somewhat by the 
number of dual credits earned. Both POS courses and dual credits (which are correlated, 
because many of the dual credit courses were taken in the POS) may serve to get students 
into a program earlier, which has Ixen shown elsewhere to increase the Itkelilood of 
completion (Jenkins & C'bo. 2012). 

• Finally, attending a four -year college was predicted by high school CiPA- not 
surprisingly, as higher achieving students tend to apply to and Iv accepted by. 
baccalaureate -granting institutions but slightly negaliwiy predicted by* attitude toward 
POS in high school. The latter finding may be explained by the fact that the POS were in 
C ‘ 1 1*. fields that are primarily pursued at two-year institutions. 

Overall, although most of the college -level outcomes of interest were most strongly predicted by 
high school CiPA. it is noteworthy that other high school variables, such ax positive attitude 
toward POS and number of dual credits earned, had a significant cfTcct on the college outcomes. 
This is particularly interesting given that the sample size for four of the seven models was less 
than 11X1: in larger samples, perhaps the relationships would be stronger. These analyses have 
shown a clear pattern that provides preliminary evidence in favor of POS participation. 


* Stulcffe icpcctiiig in hipti llui lieu POS was ir« iriulril k» lhc« <*rccr pnali wcic lc** Ifccty u> »U> in He 
ume t lisla aflci higj i mIkoJ (X* 4 24. ft < .05). 

lfiietcttiiigly. the uimJci of icnedid umjisc* was ncgaindy correlated stuvaig in tie wmc duster (-.23* •> 
(see Appnsdu D>. A! ih »h llic UMttl «ikf u uiulcui t>cvau«c these »c Itolh maitucd ai (lie kxJVrge Icvd. this 

ki^gcsts llui if •tuiaiU ICC icquilil In lake icnediaJ tttttMCl. they uic nunc likely k* Stray away f cm its; PtXS 



D. Comparisons: College S> stems Ihlu 


The longitudinal results reported in the previous section are the locus of the quantitative part of 
this study. However, to examine how students in our sample who enrolled at the atViliated 
colleges after high school compared to other students attending the college in the same programs, 
we undertook an additional set of analyses that inv olved obtaining systems data from each 
college for all students in the POS. whether or not they attended the high schools with mature 
POS. We then compared the students in our sample to similar students who entered the college 
programs from other high schools (which may or may not have also had POS). 

Instructions and data templates were provided to each college when the systems data were 
requested in order to facilitate data cleaning and transfer. Sec Appendix E for a list of variables 
available from colleges on the sample and comparison groups. Across the three sites, each 
comparison group consisted of students who were enrolled in the college POS of interest 
during the 2009-2010. 2010-201 1, and or 2011-2012 academic years (the sojik years as our 
sample!. Alter this initial filter was applied, students who graduated from high school prior to 
2009 were removed in order to limit the comparison group to stuikmts who were of similar age 
and high school experience as our sample. 


Tables 13 shows that at Desert College, students in our sample had a significantly higheT GPA 
and were taking significantly fewer remedial courses than those in the comparison group. 

( Further, although not statistically significant, the means reveal some differences that may 
nonetheless b: practically significant: The students in our sample earned more dual credits, more 
college credits, and more certificates than students in the comparison group.) 

Table 13 


Differences on Key Indicators Bern wit the Sample and Comparison Group: Desert 


Variable 

Original 

.1/ 

Sample 

SD 

Comparison (iroup 
M SD 

df 

F 

P 

Entrance exam score 

0.55 

0.15 

0.53 

0.16 

323 

0.76 

0.39 

Dual enrollment credits 

1.13 

2.4S 

0.52 

2.26 

616 

3.23 

0.73 

Number remedial courses 

2.12 

2.17 

8.28 

6.20 

3S9 

47.78 

0.00* • 

College GPA 

2.22 

1.42 

1.67 

1.31 

614 

7.27 

0.01*« 

Number college credits 

25.94 

22.71 

21.15 

21.38 

416 

2.03 

0.16 

Number certificates 

0.20 

0.79 

0.15 

0.61 

616 

0.37 

0.54 

N&+. N 50-54 tui the c« igin 

1 s 

186-308 tor the CttMpari* 

« gfOiip 





The sample sx/es far the comparison groups at Northern and River Colleges were too small for 
meaningful analysis, perhaps due to the fad that virtually all of the enrolled students attended 
one of the mature POS high schools. However, although not presented in a table, we did find that 
at Northern College, students in our sample had earned a significantly higher number of dual 
enrollment credits (10.67 vs. 0.48. F- 1 37.67, /> < .001 ) and. although not statistically 
significant, a greater number of college credits overall |42 vs. 33). JI 


'* Ddal. C*uliiur> Ails. C<MUik lion Tech. Fi tet Tctft. Ncvthem Ai£o. WcVhng. 

" PkiAC mile thtf out varrptc wc> lie tuull I IIKI ofcajf ,JMipk* »lulc«s hut Ids llun 10 in Iheeunyoittn fjmpl. 
lt»dr result* siuiuld be stlciprctcd with 






We undertook these systems data analyses comparing, students in our sample to their peers at the 
same colleges because we did not have a comparison group in the study design. That is, whereas 
the results within our sample (presented in previous sections of this rcportl suggested positive 
ctYects on students ol'POS participation, the systems data analyses were an attempt to put the 
findings in some context (albeit limited by the data that were available to us from the colleges). 

Consideration* from Quantitaliw Results 

Ik>th the within 'group and between -group quantitative analyses show that students benefit in 
several ways from P(>S participation, but the most consistent effect seems to b: from the 
opportunity for dual enrollment. Our findings were similar to those of Allen and Dadgar (2012k 
who also found that dual enrollment increased students* credit attainment and college CiPA. as 
well as Karp and her colleagues (2007), who found that students who take CTE-focused dual 
enrollment courses earn higher grades in college, further, using regression discontinuity design 
and propensity score matching to examine the effects of dual enrollment for students 
participating in the Concurrent Courses Initiative (CCI) in California. Hughes et al. (2012) found 
that graduating dual enrollment students entered the CCI partner college at a higher rate than 
their district peers ( 43% vs. 29%). These researchers also found that in roost sites, dual 
enrollment participints who enrolled in college during 2009-2010 made significant gums in 
college credit accumulation compared to other college freshmen (Hughes et al.. 2012). 

Some researchers have posited that the beneficial effects of dual enrollment arise from the fact 
that participating students leam habits related to college success, such as study stills, as well as 
how to “play the part" of a college student (Foster Si Nakkula. 2005; Karp. 2012). “The dual 
enrollment experience may allow students to begin to view themselves as capable of engaging 
successfully in college- level work** (Edwards et al.. 201 1. p. 7). Further, it may be that “dual 
enrollment fosters more positive attitudes towards earning postsecondary degrees in students 
who did not previously hold these attitudes" (Swanson. 2008, p. 7). For the students in our 
sample who took dual credit courses on the college campus, this may b: the case. It is also 
possible that students who took dual credit courses taught by a college instructor at their high 
school felt that they were treated like college students. One question raised by this study of 
mature P()S sites is whether it is the POS |vr se that is helping students, or whether it is the 
connection of the high school to the college programs, particularly the opportunity for dual 
enrollment, that helps students succeed in college. 

Although our findings support other findings in the literature regarding initial college success for 
students participating in CTE dual enrollment, to date, no study has followed dual enrollment 
students through college completion ( Abdul-Alim. 2012). However. Jenkins and Cho (2012) 
analyzed data over a five-year period for over 20.(XH) college students in the National Student 
Clearinghouse (NSC') database and found that, arming CTE concentrators, over one-third earned 
a certificate or automate degree in community college and 5% transferred to a four-year without 
a two-year credential I Jenkins Sc Cho. 2012). It is too early to tell what the ultimate college and 
career outcomes will b: for our sample, as most of our students are still enrolled in college as of 
this writing. In addition, students in this age group are still exploring options and may yet change 
directions (Arnett. 2000: Bailey. Jenkins. Sc Lcinbadi. 2006). 



Ax mentioned in the introduction to this report, dull enrollment has the moat extant research 
support of the four Perkins IV POS components, hut it should be emphasized that dual 
enrollment by definition encompasses the sccondary-postxccondary connection component. The 
other two components in the POS legislation, curriculum alignment 1 integration and 
credential 'degree foms. have not Iven studied to the sime extent but certainly warrant further 
research as promising strategies for supporting students in their college and career preparation, 
particularly as part of POS. One study found that program coherence can lead to increased 
student achievement (Ncwmann. Smith. Allenxworth. Sc llryk. 2001); another fourxl that the 
sooner students enter a program of study in college, the more likely they are to graduate (Jenkins 
& Cho. 2012). 

Compared to other countries. American young people experience a less structured transition 
from school to work (Arnett. 2000; HotVman. 201 1; Svmondx el al.. 201 11. This study provides 
preliminary evidence to suggest that students beginning their POS in high school and continuing 
in college have an advantage over those who do not. POS appear to help CTE students by 
providing a road map to college with the otTcring of a sequence of courses that leads to a 
postsecondary degree or credential; in particular, the opportunity to participate in dual 
enrollment provides critical momentum. 


I. imitations 

Prior to discussing the overall findings and limitations of this study, some important limitations 
should fo: acknowledged. The most obvious limitation is that we examined mature POS Tike 
programs that were developed poor to Perkins IV using a framework (OVAE's ten components 
of POS) that w as developed well after Perkins IV was authon/ed. Despite this disconnect 
however, it is encouraging that the sites in this study [XtKScsscd some of the suw key 
components of the legislation and the later framework. Educators and policymakers appear to he 
attuned to what seem to he the necessary ingredients for successful college and career transition 
programs. 


Another limitation is that this study only fwised on selected programs at three sites, thus our 
findings may not h: general i/able to other programs or sites. Low response rates to follow* up 
student survey’s minimize the extent to which we can draw conclusions about POS stuikmts* 
post -high school experiences, and the public information we were able to find online regarding 
students' 2012 status (lor those who did not complete a survey or have a record at the affiliated 
college) may not be accurate. Appendix F presents a missing data analysis. I lowever. it should 
be noted that this limitation is not unique to this study. Rampell (20121 noted that high school 
graduates who are not enrolled in college full time are a notoriously transient population that 
social scientists and other experts have trouble tracking, and Lipka (201 11 chronicled the 
ditViculticx in getting college students to respond to surveys, suggesting that a 20 % response rate 
is now considered adequate. However, the small numbrr of sites and low response rate meant 
that our sample size wax not large enough to test structural models or mediating variables to 
determine causal relationships brtween students* hrhaviors. attitudes, and outcomes. 

Dual enrollment emerged as a strong predictor of poxtxccoodary success in this study, as in 


41 



other*, but this finding should be viewed with Mime caution. Became there has not been a 
random assignment study of dual enrollment, it is difficult to disentangle the effects of the dual 
enrollment experience from student characteristics (Allen. 2010). For example, students with 
higher ability and motivation may be more likely to enroll in college* level courses as high school 
students. At the sites in our study, however, many of the dual credit opportunities were built into 
the POS as part of the course sequence, and even expected of POS students, so external factors 
may not have played as large a role as in schools in which students have to seek out these kinds 
of opportunities themselves. Furthermore, we heeded Allen's (2010) caution about dual 
enrollment opportunities being available only for the most able students and controlled for prior 
achievement (high school GPA) when examining the college outcomes of the POS students in 
our study. 

We also did not examine where students were taking their dual enrollment courses, and there was 
a mix within and across the sites. Spcroni (2010) found that dual enrollment predicts college 
enrollment but only if the dual enrollment course was taken at the community college rather than 
at the high school. In addition, we did not examine outcomes for students in programs of 
different levels of rigor or quality (Karp. 2012) because we only had seven POS and no two were 
in the same CTI: area (which would have provided a comparison 1. 

Finally, this study coincided with the economic recession beginning in 2008. and it is unclear 
whether or how this atVects the results. In the interviews, college administrators told us that their 
enrollments were larger than ever in 2009 and 2010. and high school representatives mentioned 
reduced budgcls for teachers and equipment and fewer opportunities for student internships in 
local companies. However, we also heard from multiple sources that regional employers were 
still eager to hire the POS graduates, particularly from the programs related to manufacturing. 

Additional limitations regarding data collection, coding, and analysis arc noted in Appendix (i. 

Discussion 

The purpose of this mixed methods study was to leam about the key components of POS that 
support students* transition to college and careers, including whether and how participation 
atTects students. Specifically, in onicr to explore the implementation of CTE POS. a new 
requirement in the 2006 Perkins IV legislation, this study sought to backward map the process of 
POS development and ofCTation at three mature. POS-like sites. Wc started from the ikrurcd end 
point of POS— colleges awarding industry -recognized credentials or degrees to students who 
began the POS while in high school —and identified (a) the key components of the programs and 
fb) the progression of students through the programs to get to this desired end point. We found 
that POS development is a complex and lengthy process, and that the key components in practice 
do not neatly align with the key components contained in the Perkins policy guidance. We also 
found that, although the majority of students do not continue with the ionic high school POS in 
college or work. POS participation does have a positive effect on a variety of high school and 
college outcomes. 

The Kickwards mapping model that guided our study was an effective way to unfxick the 
mechanisms of mature POS. Selecting sites with ev idence of intended policy outcomes, studying 
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than, and comparing their inputs with Perkins* IV' policy guidance from OVAE allowed ux to 
better understand the necessary components of POS. even though OVAE’s guidance was 
releaxed a year after this xtudy began. The most sinking commonality across the mature sites was 
a shared vision by multiple stakeholders of a seamless transition from high school to college, 
which guided subsequent practices. At the mature POS sites in this study, each of the ten 
components of OVAE’s framework were ev ident, but some emerged as more critical than others. 
Partnerships were clearly the key component -that is. multiple stakeholders with good 
relationships wxirking together to achieve a shared v ision of helping students better prepare for 
college and careers. Also important were secondary-post secondary course sequencing (with 
input from advisory committees) and credit transfer agreements allowing students to earn dual 
credit, which may require some flexibility from both secondary and postsecondary partners, 
finally, legislation and policies need to allow for dedicated stalling and the use of external funds 
to support high-quality POS development and implementation (assuming no additional Perkins 
funding). Seen in terms of their correspondence with the qualitative findings from this study, 
these four components of OVAE’x POS Framework seemed to be the common denominators in 
the three mature. POS* like sites that began poor to Perkins IV. 

Our findings regarding the need for dedicated xtatling to create secondary -postsccondary links 
and external funding sought by the colleges to support POS development were unexpected, ax 
they were neither part of Perkins IV’ or the subsequent OVAE Framework, nor were they 
included in the hypotheses we developed for this study based on prior literature. Most sinking 
was the importance of the dedicated "high school relations" staff at each of the colleges, who 
served multiple functions, including coordinating multi -stakeholder meetings about curnculum 
alignment to advising high school and college students on course selection. The importance of 
the individuals in this role to the sixeess of the POS cannot be underestimated. In addition to 
considering what supports state and li>ral educators need to continue to improve all of the 
components in the OVAE Framework, future policy and guidance around POS should help 
Perkins recipients fund POS coordinators and find ways to creatively blend funding streams to 
support POS in other ways. 

The quantitative findings regarding students* progression through the POS add another 
dimension to the research findings. In early reports from this study (c.g.. Alfeld & Hhattacharya. 
201 1). when we had indications that fewer than half of the students were continuing in their POS 
at the college level, we noted that even when a POS is well-established and mature, it does not 
guarantee that students will continue to progress through that POS. Career interests and college 
and work decisions are still in tlux at this point in students’ lives, therefore the high school to 
college transition is not linear, particularly when the number of options for possible career fields 
increases greatly when students get to college. I low ever, ax we have now found in our final 
analyses, this does not indicate that the POS we studied are not successful in preparing students 
for postsecondary education or facilitating decision-making regarding career paths. 

Notably, most of the POS students in our simple continued on to postsecondary education and 
were still enrolled in 2012. About one-third of our students were pursuing the same field as their 
high school POS. Considering the myriad piths these students could have taken, this percentage 
suggests that POS steered them in a particular direction. Combining students* survey data and 
school transcripts demonstrated that students' experience in POS is positive, and that many 



aspects of POS particularly the opportunity to earn college credit while in high school— 
actually boost students* chance* of college success, in term* of fewer remedial courses and 
higher college OP A (regardless of high school CIPAl. Student* taking more POS courses were 
also more likely to have earned a credential within the timeframe of this study. 

Future PeTkm* legislation and policy guidance should acknowledge that continuing in the same 
POS (or career cluster) after high school, although certainly one desirable outcome, is not an 
adequate measure of POS success. A more realistic outcome is the capacity that POS have for 
providing student* with the ability to make future educational and career decisions, using the 
skills they gained through participation in POS; this is especially crucial given the flux both in 
the economy and in this developmental stage of life. The stuifents in mature POS site* that began 
poor to Perkins IV. although not necessarily representative, appeared to benefit from the POS 
experience, suggesting that POS dcvclcped after 2X6 with additional policy guidance may have 
even brttcr outcomes. 

This study used a backward mapping approach to examine how POS- like sites in practice align 
with POS policy components. We found evidence that students benefit from POS but that 
additional components may need to b: added to the OVAK Framework. We recommend that 
continuity of students in the same POS from high school to college and career should not be the 
only measurement of success of the policy, and we also urge patience, as even mature POS sites 
continue to evolve and improve over time. The qualitative findings from this study suggest that 
the development of POS is easier said (or legislated) than done (or implemented ), but our 
quantitative results suggest that the effort will b: worthwhile in terms of students* postiecondary 
success. Future research should track a larger sample of students for a longer penod of tunc - 
through postsccondary education and into the workforce —to examine long-term oulcomes of 
POS participation. 
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Appendix A: I'inul lolltm-up Sum*) 

( administered online or via telephone l 


Welcome to the Programs of Study follow-up survey! You are eligible for this survey because you 
too*, a similar survey at your high school In Spring of 2009 or 2010. We are interested in learning 
about how your education experiences and opinions have changed over time. You may have 
taken additional surveys for this study at your college In the last year or two. Now. we would like 
to do a final follow-up to see how you are doing before the study ends. This Is your last chance to 
let us know how you feel! This survoy should onfy take about 5 minutes. If you complete this last 
follow-up survoy. you will receive a $25 gift card to Amazon.com (where you can buy CDs. DVDs, 
and books)! 

1- Please select any credentials or degrees you have already completed below. Chock as 
many as apply. 

O GED 

O Training or skil ccrtrtcatc from trade or tochncal school 

O Associate's degree from community cttlcgc 

O None of the above 

O Other (please specify) 


2, If you have completed a postsecondary degroe or credential, what sub)oct or career 
cluster is your credential In? 


O Agnculture. Fcod. & Malurai Resources 
O Architecture & Ccnsfrucbon 
O Ats. Audo-vdob technology. A 
Communications 

O Bjsness Management & Admnstraton 
O Education A T raring 
O Fmarco 

O Government A Puthc AdmimsfraUon 

O Heath Science 
O Hospitality A Tcurtsm 


O Human Servccs 

O Informotcn Totfrology 

O Law. Puttie safety. Ccrroiacns. A Soartty 

O Hospralty A Tounsm 
O Manufacturing 
O Marketing. Sales. A Scrvce 
O Science. Toihnotogy. Engineering, A 
Mathcmaocs 

O Transportaocn Distribution ALogisacs 
O Other ipfcaso specly) 


3. What is the tughost lovcl of education you ever hope to complcto? 

O High school diploma cr GED 

O 1 year degree cr oortiftGato from communffy or techncal colco? 

O 2 year degree cr oortlftoato from community cttlogc 
O Bachelor's degree (4 year colcgcl 
O Master s degree (MS . M.A.. M8A| 

O Medical (M O.). Law (J.D. |. Dcctcrate (Ph.DA or efrier advanced dco-cc 



4. Please select the career held that most closely matches the one you see yourself working 
In 10 years from now . 


O Agriculture. Food. & Maturai Resources 
O Architecture & Conduction 
O Arts. Audovdoo technology. A 
Communications 

O Busness f/anagement A Admnstraton 
O Education A Turing 
O Finance 

O Go*omment A Puttie Adminidabon 

O Heath Science 
O Hospitality A Tourism 


O Human Sorvccs 

O Intormatcn Technology 

O Low. Puttie safety. Ccrrecflccs. A Scarify 

O Hosp&aity A Tounsm 
O P/anutacturng 
O P/arfccting. Sales. A Scrvce 
O Science. Technology. Engineering. A 
P/atnemaocs 

O Transports c<v Distnbubon. A Legidcs 
O Other | please speefy) 


5. Arc you currently In some form of postsecondary education (o.g.. tradeitochnical school. 2 
year college. 4 year college or untvorsity). either fulltmc or part-time? 

O Yes (go to next page | 

O Wo (skip lo pegc alter next! 

O Other (please spoefy) 


6. What is the name of the postsecondary institution you are enrolled In? 


7. What kind of certificate, license, diploma, or degree do you expoct to earn In your current 

program? SELECT ALL THAT APPLY. 

O High school diploma 
O Adult Base Educatcn Ccrtrtcato 
O GEO ccrthcatc 
O Train rig or Stoll ccrtrtcato 
O AA or Associate's dp'cma or degree ( 2 year) 

O BA or BS eolege dogroo i 4 year) 

O Other {please specify) 

8. If you are currently enrolled In a 2 or 4 year college, what is your program or major? 
Choose the option that is the closest match. 


O Agnculture, Food. A Waturai Resources 
O Architecture A CcnsYucton 
O Arts. Audovdoo technology. A 
Communications 

O Busness Management A Admnstratcn 
O Education A Tuning 
O Fmairc 

O Government A Puttie Admmidabon 

O Hc^th Science 
O Hospitaliry A Tourism 


O Human Services 

O InAormatcn Technology 

O Law. Puttie safety. Ccrrecacns. A Soculty 

O Hasp caity A Tounsm 
O f/anjtacturng 
O P/arkcting. Sacs. A Scrvce 
O Science. Technology. Engineering, A 
P/atncmaocs 

O T ran sportaocn Distnbubon. A Logisocs 
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9. If you arc currently enrolled In a 2-year or 4 year college. did you take any career technical 
education (CTE) classes during high school that helped you decide on your college 
major? 

O Yes 
O No 

Wrti r the ramc d ihs class cr classes 


•Answer questions on this page If not currently in school* 

10. Do you plan to enroll in postsecondary oducatlon (e.g^ tradcitochnical school. 2-yoar or 4« 
year college) In the future? 

O Yes 
O No 


11. If yes, what type of school do you plan to enroll in? 

O Adult Basic Educaton or GEO courses 

O 1 year degree cr corthcalc program at a communty cr technical edtege 
O 2 year degree cr certhcalc program at a community cologo 
O 4 year col ego or irvrcrsity 
O I do rvat plan to return to school 


12 . tf yes. what do you plan to ma^or in? 


13. Arc you currently working for pay. either full-cime or part-bme? 


O Yes iccr&fvja to next cjjesten) 
O No (sfcjp to next page) 





14. Currently. In what area Is your VAIN occupation or job? Select the area that is the closest 
match. 


O Agnculture. Food. A Waturai Resources 
O Architecture & CcnsYuction 
O Arts. Audovdoo technology. A 
Communications 

O Busness Management & Admnstratcn 
O Education A T raring 
O Finance 

O Government A Puttie Admimsfrabon 

O Hedth Science 
O HospitaltyA Tcunsm 


O Human Services 

O Intomvaten Technology 

O Law. Puttie satoty. Ccrrccacns. A Soanty 

O Ho sp Catty A Tounsm 
O f/anutacturrg 
O Marketing. Sates. A Servee 
O Science. Technology. Engineering, A 
Maincmaocs 

O Transportabon Distribution. A Logisocs 
O Other i please spochy) 


15. Thinking about your current Job. Plow much do you agree or disagree with the following 
statements? (Mark ONE answer per statement). 



StrcngV 

Agree 

O 

Agroo 

Oaagcc 

SYorgly disagree 

My pb al'ows me to use my sblis and abilbcs 

O 

O 

O 

1 am cverquttitKid ter the work that 1 do in this 

O 

O 

Q 

O 

OB 

My job has influenced my career choice 

o 

O 

O 

O 

This job gives me cpp>orbjnocs fer 

o 

Q 

Q 

O 

advancement 

My job has helped me to get mere 

n 

n 

Cl 

n 

educabanrtraining 

My pb has gotten in the way ot th* 

n 

n 

Cl 

n 

oducaborWainiog that 1 wtxid like to got 


16. Is your current job related to the Job you want to have 5 years from now? 

O Closely related 
O Somewhat related 
O Not related at all 

17. If you are not employed AND not In school, please tel us why. SELECT ALL THAT APPLY. 


O Decs rot apply: I'm either n school 
Acrkpg. or both 
O Famly obligations 
O Porscnai or famfy member hoalth or 
dteabJtty bsuos 
O Did not ike job or school 
O Got tired or laid c4i 

O Falcd exit of school or opclcd Irom 
school 


O La: k the no cessary school rg. framing or 
skits for the krd ot job I want 
O Wo job openings tor the skills I have 
O Commute distance 1 cost or lack of 
transportation to work 
O Can t decide what I want to do 
O Completed poslhgh sc heel cducaton 
program and bokrg tor a /ob 
O In transition between sc heel anl'or pto s 

O Other ipleaso 1 st) 
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18 . Thinking about your high school education, choose whether you strongly disagree, disagree, 
agree, or strongly agree with the following statements. 



Strongly 

Disagree 

Agree Strongly agree 


disagroe 



My high school adc^gjatcty prepared me 
for work 

O 

O 

w w 

My high school adc<jjatcly prepared me 
tnr rrttnne 

O 

O 

w w 


How could your high school education have better prepared you for coBege and work? 




Appendix B: Survey Administration 


After selecting the three sites for study participation, we sent high school principals at the 
colleges* feeder high schools letters describing the study and requesting student participition. 
The number of high schools or districts feeding into each college was described in Table 1 of this 
report. See Table B*l for the high schools prr site that agreed to participate in this longitudinal 
study. 


Table B« 1 

fftyh Schools Participating tn the Study by Site 


Site 

Number ot participating 
high schools 

Number of POS 


6 

3 


3 

2 


7 

2 


Tables B*2 and B*3 below show the demographics of the sample at each of the sites. The 
students at Northern and River sites were mostly White and male, whereas the majority of 
students from Desert were Hispanic, and the proportion of males to females was more evenly 
distributed. 

Table B-2 


Percent of Sample Students of each (render by Site 


Site 

Male 

<%> 

female 

(%> 

Desert 

57 

43 

Northern 

97 

3 

River 

94 

6 

Total % 

72 

2K 


Table B-3 


Percent of Sample Stitdentr of flack Race. Ethnicity by Site 


Site 

Native 

American 1 ’ 

Alaskan 

Asian 

Black 

Hispanic 

More 

than one 

race 

Native 

1 lawaiian 

White 

Desert 

5 

2 

0 

66 

K 

1 

19 

Northern 

3 

3 

3 

3 

3 

0 

85 

River 

4 

2 

0 

0 

0 

0 

94 

Total % 

5 

7 

mm 

1 

41 

5 

1 

46 


Nule .V * 129 <91 5%) for Besot. Total V 211 <99.1*1 


The pirticipiting high schools granted the researchers access to students (whose parents did not 
opt out and who themselves assented! for survey purposes, and they provided one to twxi years of 
high school record ilita. depending on the student's grade (junior or senior! at the time of 
participation, for each participating student. 










The first high school survey was administered in the spring of 2009 to stuifcnts enrolled in 
classes that were required for the POS of interest at each site. Specifically, students in high 
school classes that were pre-requisites far Culinary Arts. Construction Tech, and Film Tech were 
surveyed at Desert; students in Mcchatronics and Industrial Maintenance classes were surveyed 
at River; and stuikmts in Welding and Auto Tech courses were surveyed at Northern. Students' 
POS were determined by which course a student was in when the survey was taken. Alter the 
initial survey administration, attempts were made to survey as many students from the original 
sample as possible as they transitioned out of high school. Survey tune points are depicted in 
Tabic I* 4 below. 

Tabic H 4 


Timvlmc ofSunvy Administration ami Method* Used 


Year 

Survey* 

Recruitment 

Administration 

Incentive 

Spnng 2009 

MS Survey 1 

Juniors & seniors 

In-pcrson 

In-|>^son 

XA 

Fall 2009 

College Survey 1 

Email 

Online 

Lottery for 


Graduated seniors enrolled in 

Instructor 


several S50 


POS at college 

announcements 


or $100 gift 



in class 


cards 

Winter 

Alternate Survey 1 

Email 

Online 

S35 gift 

2009*2010 

Seniors who had graduated but 

Mail 


cards to all 


not enrolled in POS at college 



participants 

Spnng 2010 

US Survey 2 

Email 

Online 

S25 gift 


US seniors (juniors during US 

Mail 


cards to all 


Survey 1) 

Distribution of 
survey link by 
letters in class 


participants 

Fall-Winter 

College Survey 2 

In person 

Online and in- 

S25 gift 

20102011 

Original sample students 

Email 

person 

cards to all 


enrolled in POS at college 



participants 

Summer 

Alternate Survey 2 

Email 

Online 

S25 gift 

2011 

All onginal sample students 

Mail 


cards to all 


who were Kit recruited at 



participants 


college (not enrolled in POS at 
college) 




Spnng 

Final Follow-up 

Email 

Online and 

S25 gift 

Summer 

All original sample students 

Mail 

over the phone 

cards to all 

2012 


Phone calls 


participants 

Afefe.v <iift cii<K 

given is iiRCtiiivc* were for Arrujunvi 

.rn For all OftlstC 

ttikli iliitf t« of lie 

vey, except t"o« 


Cdkp Sui>c> I, students ucic given it* of«R«t in icviuilmcnl ivuimuuxUicn, of receiving lb: Mitvcv by mill 


Recruitment. As this longitudinal study progressed, it hxAmc apparent that multiple recruitment 
methods needed to be employed fccausc students were not ncccsv&rily progressing in their POS 
in a linear fashion. For example, to obtain the first college survey sample, enrollment lists for the 
programs of interest were obtained from the colleges, with the expectation that many of the high 
school seniors graduating the previous spring would h: transitioning to the post secondary portion 







of their POS. In fact, only 16 of the 94 graduating, seniors in the spring of 2009 were enrolled in 
the POS of interest in the affiliated college the following fall (see Table ITS).* 1 Because college 
enrollment lists for the POS of interest were not yielding a large number of students from the 
original sample, the alternate surveys were introduced as a way to track education and career* 
related activities of students who were not accounted for in the affiliated college POS. 

Recruitment ell’orts relied on contact information self-reported by the student during the lirst 
survey, unless a student participated in one of the follow-up surveys and provided updated 
information, or was enrolled at one of the aHiliated colleges. At the time of the second college 
survey, sample students were recruited from the POS of interest, but colleges were also asked to 
provide u|xlatcd contact information on sample students who may be attending the college in a 
different program. For the final follow-up survey, records used for sample recruitment were a 
combination of original contact information reported, updates lrom the alliliated colleges, and 
information that was publicly available through online search engines and social media. 

Recruitment strategies and communications took into consideration accepted guidelines for 
better response rates. Specifically, emailed arc! mailed messages were iwsonalized. addressing 
students by name, multiple communications were sent to non -responders with varied approaches 
(i.e., a more detailed initial invitation, followed by boef reminders referring to the original 
communication with a deadline for responding !; and the value of receiving participants* 
perspectives through surveys was conveyed (Dillman. Smyth. A: Christian. 200Kf Recruitment 
messages were also timed strategically, taking into consideration the type of contact information 
available and the timeframe of recruitment (c.g.. students may not be frequently checking a 
college email address during summer or semester breaks). 

When more than one form of contact information was on record for a student, email was 
typically the first strategy used. Given the age range of our sample (i.e.. late teens to early 
twenties), it seemed that email would be the preferred method of communication, if this type of 
contact information had provided to the researchers. Mailing addresses were used as a 
second strategy if a participant did not respond to email, or if an email address was not on record 

For the final follow-up in 2012. two new strategies were implemented: social media (i.e., 
Faccbook) and phone calls. These strategics had not been used during previous survey 
administrations due to the challenges involved outweighing their potential return. However, it 
was deenkd that all strategics possible would b: attempted for the final follow-up to determine 
the status of as many students as could be found. Ultimately. Faccbook did not garner additional 
survey responses but proved to be a useful tool for tracking education and career activities for 
sample students who did not rcsjxind to the final survey. Fhone calls were more successful 
some students who had not responded to any surveys since the initial high school survey were 
recruited via phone calls to take the final survey online, and it was administered over the phone 
to others. 41 

Sun*)' uduiinistraiionL In addition to various recruitment methods, multiple methods of survey 


“ Tu nuU* il nr*o a program cirmllmcil lit!. Ite tlu 4cti. w<«ild i»:nl In dxhee u mm jt«. Sli>A_-r*, eculd t»; liking 

<hc*c% t Hour* fin their POS al lie college <* iiIkuI uAmg Iht* *tcp 

' S«sie fcDidrtil* rxt u*cJ by picric iei|iA:%k*il llul i link Co the online tuvey tc *cnl k* chon thiuigh erruil. 



administration were employed. Nearly 100% of students in the POS of interest participated 
during the first high school survey administered in their cla»rooms. Although in-person 
surveying was not always feasible for future survey administrations <c.g,. there was no common 
physical location or time when: targeted students were located for alternate surveys and the final 
follow -up). attempts were made to make recruitment more personal and important by enlisting 
the help of teachers for the secood high school survey and faculty at the colleges for college- 
level surveys. Specifically, teachers and faculty provided vertxil reminders and made bncf 
announcements in class atxiul the survey. Response rates are provided in Table B-5 below. 

Table IT S 


.V t vmn iwiws ft\ Sitf 


Survey 

Desert 

River 

Northern 

Total 

IIS 1 

131 

47 

35 

213 

IIS 2 

24/82 

7/17 

316 

34/115(30%) 

College 1 

Ni'A 

2/13 

03 

5/16(19%) 

College 2 

2/9 

2<'3 

3/5 

7/17(41%) 

Alternate 1 

8*49 

217 

315 

13/81 (16%) 

Alternate 2 

10125 

4/43 

030 

14/198(7%) 

Final Follow-up 

38*131 

S/47 

7/35 

50213(23%) 


Sol 4 . No i:i(liui>iu: at who pula poril itt ihc tin*ssu] hi^Ji »uni> were cfimlled in rt*: POS 

of interest u the wtlcjc rte fulluumg Fill 


Sun*)' limitations. At the time of the initial survey, students were asked to write their names and 
contact information on a detachable cover sheet at the beginning of the survey document. The 
research team dxi not have access to class lists, which made student self- reported contact 
information our only miutcc of information for follow -up activities. Illegible handwriting and 
inaccurate contact information posed a challenge during the first few rounds of follow-up. 

The college survey samples were smaller than expected because recruitment was limited to 
students who were enrolled in the POS of interest. Original simple students could he attending 
the affiliated college (and a number of them were) in a different program or without declaring a 
major, unbeknownst to the research team. In later phases of this project when college records 
were obtained, this became clear. Updated contact information was obtained for all original 
sample participants who had attended one of the atViliated colleges, and they were recruited for 
the final follow-up survey. 

Many of the follow-up activities relied on students having internet access. Those students who 
have regular access to a computer and a frequently checked e-mail address may be those who are 
less mobile and more likely to be in school or have a professional job. Students who are willing 
to repent on their education and career activities, or to post these activities in a public space like 
Faccbook. may have more positive experiences to report. 






Ap|K n<li\ C: l’vin'4 the CSSC for Transcript Coiling and Details on Variable Construction 

from Transcripts and Surveys 

Transcript coding A variable construction. The Classification of Secondary School Courses 
(CSSC), developed from the High School Tnimcript Studies 1 1 1ST I in 2000 was used as a basis 
for coding high school transcripts. The CSSC is structured as follow*: Courses within a program 
area are uniquely identified by a 6 digit code. The first 2 digits represent the main program area 
(c.g.. Physical Sciences). The next 2 digits represent a subcategory w ithin the program area <e.g. t 
courses that fall under Pure Chemistry), and the last 2 digits define the specific course within the 
program area and subcafegory (c.g.. Organic Chemistry) The Clfc jxution of the CSSC was 
revised in 2007, thus the updated version was used for our coding of courses in this area. At the 
high school level, each course that a student took for credit was coded. Courses on student 
transcripts were matched with CSSC coifcs using the criteria described in Table C-l. 

Table&l 


Process for Determining Transcript Course Codes 


Decision 

Level 

C riteria 

Outcome 

1 

( oursc name on transcript matches CSSC 

course name 

Transcript course coded with 

CSSC* code 

2 

f If iV 1 not met) Course name on transcript 
fits course description in CSSC 

Transcript course coded with 

CSSC code 

3 

Ilf A 1 and V2 not mel t Other related content 
areas of CSSC checked for potential match 

(If match found) Transcript 
course coded with found CSSC 
code 

4 

(If H 1 — #3 not met) Course does not match 
existing courses in CSSC 

New code assigned, following 
pattern of CSSC coding 


Eiiforts were made to match as many courses as possible to existing CSSC codes. New counte 
codes were added only if a course seemed dissimilar enough from courses categon/ed under an 
existing cod:. Because the CSSC was about 10 years old at the time transcript coding for this 
study commenced, some specific CTI: areas (e.g.. digital media) were under* dev eloped in terms 
of variety of courses and codes available. The most recent version of the CSSC addresses some 
of these shortcomings: however, it was not available at the time of our coding. Therefore, the 
final transcript coding, scheme used is loosely Kiscd on the CSSC* categorization. but new 
classifications and categories were added to accommodate courses that did not tit in the existing 
template. A number of additions had to be made for computer technology -related and digital 
media -related courses. 

Because course names on transcripts were not identical across sites or even across schools within 
sites, multiple courses were sometimes identified as one course code (c.g.. General 
Communication Skills, f Essentials of Communication, and Communications all were categorized 
under one course code). 

If the general content of a course could not be determined by the course name and a matching 
CSSC code could not be readily identified, course descriptions were searched on school 






websites. Brief course descriptions were sought from guidance counselor* or other administrators 
at relevant high schools for any courses that remained unidentifiable alter checking school 
websites online. 

In addition to course titles, course grades and credits earned per course were directly coikd from 
transcripts. Not all high schools repotted grades identically - some provided letter gru&s. others 
provided percentages, and some provided both. Grades were standardized and coded as desenhed 
below. 

Table C-2 


Standard iz in % Grades 


Letter grade 
(if provided) 

Percent 
(if provided) 

Code 

assigned 

A 

90 - 100 

4 

B 

80-89 

3 

C 

70-79 

2 

D 

60-69 

1 

F Incomplete 

0-59 

0 


In addition to individual courses and grades, available standardized test scores and cumulative 
high school GPA were entered directly from high school transcripts. From this information, 
several additional variables were created for each student (refer to Table 4A in this report). These 
new variables are explained below. 

• Dual credits earned: Dual credits were recorded on both high school and college 
transcripts, however, the credit counting process was not identical across levels (c.g,. a 
dual credit course might count for two credits in high school and six in college). All dual 
credit courses taken by high school students were determined l or confirmed) by matching 
high school transcripts with transcripts obtained from affiliated colleges. A sum of the 
total number of credits earned at the college level was created. 

• Number of courses within the POS cluster: The POS cluster was based on the student’s 
POS in high school. High school courses that were considered relevant to each POS of 
interest were included in this count. Sec Table C«3 below for examples. 

• Number of courses in a different cluster: Any CTE courses a student took that were 
outside of his or her POS cluster were included in this count. 

• Number of Honors courses : Any academic or CTE courses identified as Honors. 
Accelerated. Advanced, or Advanced Placement < API were included in this count. 
Electives courses (e.g.. Advanced Art) were not included. 

• Number of .1 lath 'Science'Soc iat Studies/Engl is h credits: The total number of credits 
taken in each academic subject area during high school was created as four different 
variables. 

• Math. Science. Social SnediexSEngtish'C TE/Elecihes GPA: Calculated from grades earned 
in each subject area, yielding six different GPAs for each subject area 1 course category*. 

• Number of upper- level Math courier. Included I lonors Algebra I and II. Prc- AP or Pre- 
International Baccalaureate (IB) Algebra II. Algebra III and Accelerated Algebra III. 
Honors Geometry and Pre-AP or Pre-IB Geometry. Pre-calculus. Honors Pre-calculus. 






Calculus, and AP Calculus. 

• Number of upper* level Science courses: Included I lonors Intro to Physical Science* 
Honors Integrated Science* Honors Earth Science* Honors Biology and Biology 11. Pre* 
AP or Pre- IB Biology, AP Biology, Biotechnology. Honors Chemistry. Honor* Intro to 
Chemistry and Physics* Honors Forensic Chemistry. AP Chemistry. Honors Anatomy. 
Physics and AP Physics. Honors Space Science and Aerospice Science, and Aerospace 
Science II. 

• Number of academic credits Included all credits earned in academic subject areas (e.g.* 
Math. Science* Social Studies. English. Foreign Languages). 

• Number of CTE credits Includes all credits in CTE areas (i.e.* does not include academic 
credits or lileclives). 

Table C-3 


Examples of Courses Within POS clusters 


Cluster 

POS 

C ourses Included in Clutter 


DESERT COLLEGE 


I lospitahtv & Tourism 

Culinary Arts 

Culinary Arts I 

Culinary Arts 11 

Nutrition 

I lospital ity T ounsm 

Food Service I 

Food Serv ice II 


C onstruction Technology CAD ENG 1 

CAQENCi II 
CAD' Arch Draft I 
CAD Arch Draft II 
Woods I 
Metals I 
Metals II 
Prodtech Woods 
Small Engine Mech 

Comm Skills through TV Prod 
Animation I 

Animation II. Animation II Lab 
Animation 111. Animation III Lab 
Computer Graphics (1* II) 
Digital Photography 
Digital Photography 11 
Media Arts I 

Media Arts II, Media Arts 
I (/Yearbook 
Media Arts III 
Hollywood Project 
Intro to Film Production 


Arts. Audio- video Film Technology 

Technology, 3c 
( ‘onimun :cat sons 


Architecture 
Construct ion 
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Intermediate Film. Intermediate 
Film Production 
Advanced Film 
Television 1 

Video 1 Audio Production 
Video Advertising 
Drama 
Drama II 
3D Computer Art 
Inventor 3D Modeling 
Autodesk Inventor 
Illustration I. Illustration II 
Mass Media Communication 
Mass Media Society 
Communication Skills 
Desktop Publishing 
Digital Editing 
Photoshop 1 

Basie Application Design 

river cot i. i::.i 

Science. Technology, Mcchatronics Adv Three Dimensional Design 

Engineering & Architectural Drafting 

Mathematics Computer Applications I Regular 

or Accelerated) 
Computer Tech 
(’one. Fngin. Tech 3 
Drafting I (Regular or 
Accelerated) 
Engineering Design 
Engineering Technology 
Industrial & Engineering 
Machine Tool Technol 
Mcchatronics 
Mechanical Comp 
Mech. Pncu Hydro C*omp 
Manufaet {Indus. Tech) 

MIT Engineering Tech 
Small Engines 
Sm Pwr Ex\ 
StrcngtbSpced Accel 
Technology Concepts 
Special Problems Tech E 2 
Two Dimensional 
Three Dimensional AC 


Manufacturing 


Industrial Maintenance 


Adv. Three Dimensional Design 




Comp Maim Syst Tech 
Drafting (Regular or Accelerated) 
Manutact. Indus. Tech 
Machine Tool Technol 
OCTC Machine Tool 
OCTC Machine Tool 2 
Small Engines 
Sm. Power Structures 
Strength Speed. Accel 
Three Dimensional AC 
Technology Concepts 
Welding 

NORTHERN COLLEGE 

Ag Mechanics 
IND- Metal Fabrication 
Design Implementation 
Advanced Manufacturing 
Welding I 
Manufacturing Tech 
Small Engines 

AAS Engine Performance 
A AS Tech Elcctnc 
Auto Wheel Alignment 
Brakes 

Disc Academy Auto (A, B) 
Disc Academy Eingr (A. B) 
Intro to Auto 
Intro Eiccincity 

Intro to Engineering Design (A. B) 
Metal Fabrication 
Intro to Metals 
Power & Energy 
Small Engines 
< ien Auto Sen 

College tramcripts were obtained for students in the sample who enrolled at the affiliated college 
for dual credit courses and or enrolled as a college student after high school. College tramcripts 
for students who only took dual credits at the high school were used to confirm the number of 
dual credits taken while in high school, and to determine w hether or licit a student had earned a 
certificate by the time of high school graduation. For students w ho had records at the atViliatcd 
colleges alter high school, the following variables were created (sec Table 4B m the report): 

• Number of non -credit courses: The number of remedial .'developmental noncredit courses 
taken. 

• Number of credits earned by end of first year The total number of credits earned during 
the first year of college enrollment. post*high school H.c.. not including dual credit). 
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• Total number of college credits to dote (20/2): The sum of all credits earned at the 
college as of the end of spring semester in 2012 . 

• Ratio of credits attempted to earned: A ratio of total attempted credits at the college level 
to credits earned. Credits attempted was the credit sum of all courses reported on the 
college transcript, included classes students withdrew from t>r failed (because they would 
not have appeared on the transcript if the student had withdrawn during adl drop period). 
Credits earned included only the courses that students passed. 

I 'enable construction from surreys. For data analysis purposes, some survey items that grouped 
together in factor analyses were converted into scales. In section A of the quantitative results (see 
Footnotes 15 and 16). attitude toward POS. beliefs about information learned in school, and 
consulting with a counselor are mentioned as constructed scales. See Table C*4 for the survey 
items that made up each of these scales. 


Table 04 

Construction of Sc ale Variables from Surrey Items 


Scale 

Survey Items 

Alpha and 
Scoring 

Attitude toward 

Having a POS has... 

a-.S5 

POS 

• Made me more likely to want to come* to 

1 - Strongly 


school 

disagree 


• Made me lew likely to want to drop out of 

2 - Disagree 


school 

3 - Agree 


• Helped me gel better grades 

4 - Strongly 


• Made me feel like I lit in better at school 

• Helped me make connections 

• Made it more likely that I would lake courses 
that 1 need for the future 

• Made it more likely that my parents got 
involved m my selection of courses 

• Made me focus my studies so 1 know where 1 
am headed 

agree 

Beliefs about 

Most of the information learned in school is will 

a -.81 

information learned 

be... 

1 - Strongly 

in school 

• Useful for everyday life 

disagree 


• Useful for college or further training 

2 - Disagree 


• Useful for my career 

3 - Agree 

4 - Strongly 
agree 

Consulting with a 

How often have you consulted with a counselor on... 

a - .82 

counselor 

• Course plan 

0 - Never 


• What courses to take this school year 

1 - One or more 


• Going to college 

• Possible jobs or careers when you are an adult 

• Your grades 

tunes 



• Finding a job after high school 

• Steps necessary to pursue your career 

• Applying for college or vi>rational technical 
school 

Note, Dill tfttscc: IliplncKxil 2 009 Iicv«y. The ilcm *rtnr^> kiudtfd it mil inJudir^. hi tte om%uXac^ 

u ilh luutacliif uuk bciMiic * did ik< gj««|i m ilh ll».* tilbei itcm% 
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Appendix I): Additional Statistical Tables 

The following tables present the results of additional statistical analyses referred to in the quantitative scclion of the report. 
Table D ! 

Cross -Sectional Summary Tabic of Relationships Among Key High School Variables 
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Highlights: 

• Number of Math credits was positively related to staying m the same POS cluster (.2 1 • • ) 

• Number of Science credits was positively related to staying in the same POS cluster (.23**) 

• Number of CTE credits was negatively related to the number of remedial courses taken (».26*), positively related to college 
GPA f.24 a ). staying in the sunc duster i. 37 - *>, and earning a credential (.17*). 








Tabic D«2 


Cams •Sectional Summary Table of Relationships Among Key College Variables 



Entrance 

Remedial 

Year 1 

C ollcgc 

Stayed in 

Earned 


Variable 

exam score 

classes 

credits 

CiPA 

cluster 

credential 

Attcn&d four-year 

Entrance exam score 


-.447** 

.208 

J42** 

.108 

.094 

.178 

Remedial classes 



.166 

-.176 

-.281** 

-.085 

..165 

Year 1 credits 




J92** 

.166 

.358** 

.207 

College CiPA 





.180 

.279** 

.194* 

Stayed in cluster 






.159 

..153 

1 lamed credential 







..002 

W< * «•' *v "i 


crclliia:** 

MC StMtlklKUlly X^ll 

I '.Mil At lC4ll y ■ 
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Table D-3 








Correlations Between Selected High School Transcript Data with College Outcomes' 





Entrance 

Remedial 

Year 1 

College 

Stayed in 

Earned 


Variable 

exam score 

classes 

credits 

CiPA 

cluster 

credential 

Attended four-year 

Consult with counselor 

.191 

-.143 

.155 

.194* 

.069 

.117 

.134 

t* POS credits 

.101 

-.260* 

.071 

.235* 

.421** 

.235** 

.053 

i* CTE credits 

.029 

-J61* 

..(K44 

.239* 

J65** 

.173* 

-.009 

H Math credits 

.079 

-.295** 

.030 

.154 

.214** 

.097 

.161* 

•Science credits 

.085 

-.269* 

-.047 

.207* 

.227** 

.105 

.180* 

H of Dual credits 

-.199 

-.347** 

.014 

.245* 

.241** 

.176* 

.185* 

Overall CiPA 

.429** 

.043 

J30** 

298** 

.024 

.100 

.463** 

CTE CiPA 

.403** 

-.154 

.176 

.281** 

.061 

.112 

.417** 

Math CiPA 

JR9** 

-.136 

J87** 

J49** 

.115 

.072 

.376** 

Science CiPA 

JI9** 

-.135 

.255* 

JI8** 

.154 

.088 

.427** 

Internship Co-op 

.084 

.046 

.083 

.146 

.073 

.020 

.001 

English STS 

.443** 

-.246* 

.171 

.202 

.039 

.079 

.262** 

Math STS 

.613** 

-.328** 

.207 

.420** 

.210* 

-.026 

.263** 

Attitude toward POS 

.082 

.091 

.220* 

.135 

.214** 

.018 

..123 

w« . * .ii? *v «»i 
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Appendix E: Comparison Analysis 


Table IM 


Data Received from College* on Sample anJ Comparison Croup Siudcitir 4 * 


Variable 

Original Sample 

( <impanson Group 

1 hgh school 

•-Already known from 

To determine whether comparison group 

attended 

1 ligh school 

IIS data> 

students attended a POS high school (Le- 
high school with existing partnership with 
college) 

The comparison group was restricted to those 

graduation year 

^Already known from 
IIS data> 

who entered college as beginning freshmen 
since the 2009-2010 academic year, in order to 
be as comparable as possible to our simple 
lie., excluding returning adult students) 

Major 

To determine if 
students stayed in same 
pathway as 1 IS POS 

Only students not in our sample and enrolled 
in tlv: POS of interest from the 2009-2010 
academic year to 201 1 *2012 academic year 
were included 

Entrance Exam 
Number of dual 

✓ 

✓ 

enrollment credits 
Number of non* 

✓ 

V 

credit courses to dite 

✓ 

V 

Total number of 
college credits to 
date 

✓ 

✓ 

Enrollment in degree 
program 

✓ 

✓ 

College GPA 

✓ 

✓ 

Semesters enrolled 

✓ 

V 

Certificates, degrees 
earned 

✓ 

✓ 

Birth Year 

✓ 

✓ 

Race and gender 

✓ 

V 

Student status 

✓ 

✓ 


*' To crcilc Ac ou»l equivalent to<iifurr«Mi group ft« uu NiuiUrui ami Desert simple*, sdditiurul filtcis ucic 

i|i|il>;il Aliy ><ulcnl> been before 1990, bimIujIoI high nfcmtl alter 201 1, or ti*mfcitcd into Ihc college from 

Jliultef ivtlccv »«ic KfflMDdflOl lie comfumufi ?ji«jp. Any rfulorl *fco lud attended MC of the P(>S high 
scIkoI* in me sample were icmo^ed <lt»ey would but c btvn ctpmsd 10 lb: *imc POS ut ih: laigcl MJ tin* 

conljfiiiiulcdi At NihAcmi. any Huifcul uhfl cluntvd tiu.ii major to >iim;llni« oilirt lUm Ac K)S of interest was 
icn»x cd fium Ac exettpuitufi group k» sutnec match. TTic cttupimnfi group ai River College 1MI00 xnull k» i*&l 
addiliurul Illicit of make my Uirnparbom 
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Appendix F: Missing ihlu Aiulvm 


A non -response bias analysis wax conducted to determine if study participants responding to 
follow-up surveys have dilVerent characteristics from participants who have not responded. The 
original sample of 213 high school students, surveyed on site in the spring of 2009. was divided 
into two groups, as follows: 

• Respooderx (*V — 82): Students who completed the first high school survey and responded 
to at least one follow-up survey. 

• Non responders (A T — 131 >: Students who did not participate in any surveys after the 
initial high school survey* in 2009. 

( hi squared analyses indicated no significant differences between follow-up response statuses 
based on gender X 1 <1. 210) - .13, p - .72: study site. A* (2, 213) - 234 , p - .33; grade level. X* 
(l,210)-I.ll,/>- .29; or immediate plans alter completing high school. A' (4, 193)- 7.16, p - 
.13. 4 However, there was a significant difference between follow-up responders and non- 
responders on student reported level of education obtained by fathers: A^ (5. n - 173) - 18.26./7 
- .00. Forty-seven percent of non -responders, compircd to 21% of responders, reported that their 
father's highest level of education as completing a high school diploma or GED. whereas 22% of 
responders, compared to 7% of non -responders, indicated graduating from a four-year college or 
obtaining a master's as their father's education level. There were no significant differences on 
mother’s education between the two groups. 

Additionally, a significant difference existed between responders (.1/ - 2.79. SD — .67) and non- 
responders (4/ - 2 46. SD - .63) on high school (iPA: /f 188) - .3.50.p - .001. 

Finally, responders and non -responders differed significantly on their expectations (ax high 
school students in 2009) of how far they* would go in school. X* (4. n - 207) - 10.54, p - .03 44 

Overall, responders had higher educational aspirations than non -responders. Specifically. 34% of 
responders, compared to 23% of non -responders, aspired to an advanced degree; 30% 
responders, compared to 20% of non responders, aspired to a Bachelor's degree; and IS%of 
responders, compared to 35% of non -responders, aspired to a certificate or A»i>:iatc's degree. 
Overall, then, students who responded to the surveys tended to have higher achievement, higher 
aspirations, and higher levels of father's education than non -responders. However, tarausc we 
were able to supplement the final survey data with information on college and work status 
obtained via online searches and college transcripts, some of the non- response bias may be 
mitigated. 


41 "PI*** rtei Mi nchcot* ife.lufed the (dim* in* category. <a| enroll m a &«jr.ymr eollcgc’unveisify. <b) cttnll 

in a lau-ycur cxlfcjc c* enroll hi a (wo-vcai college then irarnfer in a (uui-vcai college, ic) cttnll in (ccIimkaI ur 
:«.* A- «.Ik«.I. id| jnin the mil«ary. gel a job. ci pod cectuiiunily MZivicc. And (e) >*u it a family. Havel, utpiid 

cniumiiiily service. « ureairc. 

M *Tlow Ut yuu Mill gn *n idmoP inriuded lie lnlluw Aig etfegeeiev la) mil cunifdeic high >iKx>l or entu a GED or 
hi|A selinnl diploma. Ibi earn a cciIiIa. aIc or UMCiltt'i degree It urn a commonly college: Ic) cam a liAclclnr'* 
dsgice. <d) cam a Master**. EXxinntfc. <* iChrr adv anted degfec. Mtd (c) dciTl imm 



Appendix (I: Limitation* 


In addition to those limitations presented in the discussion section, this study has several other 
limitations. 

Several sites that were highly recommended for inclusion in this study and met all of our initial 
criteria declined our visit on the basis of limited time and resources for hosting researchers. For 
this reason and because of our own limited time and resources, we do not claim to have 
conducted an exhaustive search of potential sites. However, we do offer a range of approaches to 
POS implementation that contributes to our understanding of how POS were developed and arc 
being implemented at the local level. 

The original sample was defined as students enrolled in classes required for selected POS. In the 
River and Northern sites, students may have been note likely to intentionally take a claw 
because they were pursuing a pirticular POS pathway. At the Desert site, the POS were more 
recently developed. Students were not always aware that they were on a pathway, or that they 
may have been taking a class as an elective. Students at the Desert site were more likely to list 
other, unrelated career paths as responses to the survey question. "What is your program of 
study?" In the overall sample. 20% of students (the majority of whom —93% — were from the 
Desert site! listed an unrelated career path, responded ’*! don't know"' or left this question blank. 
We coded these students as being in the POS for the class in which they took the survey 
(culinary, construction, or film), but it may he that students at this large site had many more POS 
options and were therefore more likely to change, or that students had not yet grasped the POS 
concept and interpreted the survey question as asking about their desired career path. 

On surveys, pirticipints were asked to indicate the cluster of which their POS or job was a part, 
depending on the question. The rationale for making this a close -ended question was to mmimi/e 
the amount of data that wxiuld need to be re-coded by the researchers. However, the clusters arc 
not always as straightforward to students, who may classify their major inaccurately. For 
example, students enrolled in Culinary Arts sometimes classified their major as within the 
Agriculture cluster instead of Hospitality and Tourism, because “Food” is included in the 
Agriculture cluster label. Other students did not classify Aulo Tech under the Transportation. 
Distribution, and Logistics cluster, instead marking "other” because the association was not 
dear. On a related note, whether or not a student stayed in the same POS or cluster was based on 
whether their college major or employment field was clearly linked to their high school POS 
(c.g.. Auto Tech student currently working as an auto mechanic). However, a student may have 
selected a different cluster as their major, even though their career aspiration was still linked to 
the original POS (e.g.. an Auto Tech student who aspired to own his own auto shop and selected 
Business as his major). 

Some students were unidentifiable by the school or district, depending on the site, when records 
were requested after the school year. Although schools and colleges were able to provide 
corrected information for Mime students, a few remained unidentifiable in some cases, jvrhaps 
due to an incorrect name on file. 
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